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Chapter 1 

Fundamental Principles of Statistical 
Physics 

1.1 Review of Topics in Classical Mechanics 
1.1.1 Hamilton's Equations and Phase Space 

Axiom: The state of a system with n degrees of freedom is completely determined by n 
coordinates qi(t) and n velocities <ji(t) (for i = 1, . . . , n) 

Lagrangian: The Lagrangian can be written as 

C(q,q,t) 

where 

»(*) = ^ and q(t) = {qi(t),q 2 (t),...,q n (t)) 

Momenta: Similarly, the momenta Pi(t) can be expressed as: 

dC(g,g,t) 

Pi(t) = 7T. 

dqi 

Definition 1: The Hamiltonian or Legendre Transformation of C is given by the function: 

n 

H(q,p,t) : = ^pm - C(q,q,t) 
i=l 

Definition 2: The space of 2n-tuplets (q,p) = (qi, q2, ■ ■ ■ , qn,Pi,P2, ■ ■ ■ ,Pn) is called the 
phase space of the system, and is denoted by T = {(q,p)}. 
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Theorem: For every path q(t) in W 1 , there is one and only one path q(t),p(t) in T. The 
path in T in determined by Hamilton's Equations or the Canonical Equations. 



ft(t) 
Pi(t) 



dH(q,p,t) 
dpi 
dH(q,p,t) 
dqi 



which are equivalent to the Euler-Lagrange equations: 



c^dC _ dC 
dt dqi dqi 



Proof: See Phys 505 



Remark 1 : The Euler-Lagrange equations give n 2nd order ODEs, which is equivalent to 
the 2n 1st order ODEs given by Hamilton's equations. 



Remark 2: Given an initial point (qo,Po) with go = l{t = 0), po = p(t = 0) then this 
uniquely determines the path q(t),p(t). Thus paths in phase space can not cross. 

P 




q 



The above is NOT physically possible since t = could be chosen to be at the 
intersection, which would give two different paths with identical initial points. 



Remark 3: Using chain rule: 
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Using Hamilton's equations, 

A , . . . . , dH 

= 2^ {QiPi-Pigi) + -fa 
i=l 

_ 8H_ 
dt 

So if the Hamiltonian has no explicit time dependence, then 

which is a 1st integral (conservation law). Thus, as H (qo(t) , Po{t)) = E which is 
constant, energy is conserved or autonomous in the problem. 



Example: Let's look at a 1-d Harmonic Oscillator 

dq 



n = 1, C = \mq 2 — \kq 2 , =4> p = ^ = mq 



H = pq — £ = mq 2 — \mq 2 + \kq 2 
= \vnq 2 + \kq 2 



The phase space orbit in then 



p 2 g 2 



2m£ 2E/A; 
The canonical equations are: 





dH p 


q = 


dp m 




dH 


p = 


dq " 




k 




q = -, 

m 



kq 



where uj = \ as per normal. 
V m 1 
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Figure 1.1: Phase space diagram of a simple harmonic oscillator 
with energy E. 

1.1.2 Phase Flow 

Let 

(q(t),p(t)) = z(t)GT 

= (<?lO),<?2(», • • ■ ,q n (t),Pl(t),P2(t), . . .,Pn(t)) 

Definition 1: The set of mapping U : T — > T, 

U(t,t )z(t ) = z(t) 
is called phase flow or time-evolution . 

Proposition: The time evolution operator, or propagator, U(t,to), has the properties: 

1. U(t,t) =1 Vt 

2. U(t, h)U(h,t ) = U(t, t ) Vt, t , h 

3. U-ifato) = U(t ,t) VMo 

Proofs: 

1. 



u(t,t)z{t) = z{t) Vz(t)er 
:.U{t,t) =1 
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3. 



C/(MiMti,to)2(*o) = U{tM)z{ti) = z{t) 
= U(t,t )z(t ) 

.•.£/(MiWi,*o) = U(t,t ) 

U{t ,t)z(t) = z(to) 
U- 1 (t ,t)U(t ,t)z(t) = U-^to^z^) 
z{t) = U-\t ,t)z{t ) 
= U(t,t )z(t ) 

.-.U- 1 (t ,t) = U(t,t ) 



Remark 1 : Knowledge of the phase flow is equivalent to knowledge of the solution of the 
canonical equations. 



1.1.3 Liouville's Theorem 



Theorem: Let 

dT = const • dq\dq2 ■ ■ • dq n dp\dp2 ■ ■ ■ dp n 
be the element of volume in phase space. Then 

dT = constant 

In other words, phase flow is volume preserving. 

Proof: 



9t+T,Pt+T =<t,P 



Qt,pt = g,p 



Let q,p = qtiPt represent q,p at time t, and q',p' = qt+ T ,pt+ T represent values of 
q, p at time t + T. Then we want to show that 

J dq ± dq 2 ■ ■ ■ dq n dpidp 2 ■ ■ ■ dp n = J dq x d' 2 ■ ■ ■ dq n dp\dp 2 ■ ■ ■ dp n 
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But 



where 



/ 



dq[ • • • dtfndp'i • • • dp' n = / Jdqi--- dq n dp\ ■ ■ ■ dp n 



J 



d(qi, 

M 
dqi 



dqi 
dqi 



dpi 



) QniP'li ■ ■ ■ iV'n 



,q n ,Pl,---,Pn) 

.MM.. 

8q„ 8p n 



dq[ 



where J is the Jacobian and is the determinant of the above matrix. Proving Li- 
ouville's Theorem then boils down to showing that J=l. This can be shown using 
results from Advanced Dynamics: 



1. The change in p, q during motion may be regarded as a canonical trans- 
formation. 

2. Volume in a phase space is invariant under canonical transformations 
(i.e. J = 1 for canonical transformations). 



1.1.4 Poincare's Theorem 

Theorem: For full mathematical representation and proof , see "Statistical Mechanics" by 
Huang. A system having a finite energy and confined to a finite volume will, after 
a sufficiently long time, return to an arbitrarily small neighborhood about almost 
any given initial state. 

Remark 1: Thus, V returns to U after a finite number of steps. This is called the 
Recurrence Theorem . 

Remark 2: Recurrence occurs arbitrarily often and arbitrarily accurately (since U is 
arbitrary) . 

Corollary: Let's consider a conservative mechanical system at some initial time to be 
in a state given by a point in phase space, zq 6 F. Then the system will come 
arbitrarily close to zq again in finite time. 
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Figure 1.2: Graphical representation of Poincare's Theorem. The 
outer shape is some bounded region in R 2 (for example), Vq is the 
initial state of the system, U is a neighborhood around Vo, and the 
lines mark the path of the system through time. 



Example: Gas in a partitioned container 




At to, we 
break the 
partition 



h > t 



t 2 > h 



So, according to Poincare, at finite t2, all the gas will go back into the single side 
of the container! 
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Problem: This is NOT what we observe! 
Solution: 

1. The "finite" time is ridiculously long for large systems. 

2. Anything else? Yes! According to Boltzmann, this state would rep- 
resent a "fluctuation from equilibrium and is thus still consistent with 
statistical description. 

1.1.5 Necessity of a Statistical Description of Many Particle Systems 



Example 1: Here we'll look at a free particle in 1 dimension (which is thus not bounded). 

P(t) = Po 

q(t) = Q0+ (-) t 



P 





t t h> t t 2 >h q 

By Liouville's theorem, the volume in phase space in conserved. But it never 
returns to its initial state since the region is not bounded (and thus Poincare does 
not hold). 

Example 2: Now we'll look at a particle in a 1 dimensional potential well (so the system 
is now bounded). 

p(t) = ±p 

= Qo + ( — J t + inverted motion 

As seen in the following figure, notice that p is not continuous, and thus the region 
becomes disconnected. Thus we should modify the theory to allow for disconnected 
volumes. Also note that, as t — > oo, the disconnected parts become thinner and 
thinner, which leads to spaghetti structure. 
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V 



Po 



1 












to 

A 





-Po 



Figure 1.3: Spacial and phase space plots for a particle trapped 
in a potential well. 



Example 3: For the final example, we'll look at a particle scattered by a hard sphere in 
3 dimensions. 




A qi 



■ ^ ■ ■ ■ -jAb = Aq 2 

► impact parameter = b 



We know that 



sin a 



A Ql = Aq[, Aq' 2 > Aq 2 = Ab 



So the q contribution to phase space volume increases due to scattering. This means 
that, in order to keep the phase space volume invariant, the moment contribution 
must decrease. Let 



a < 1 



Aa = 



Ab Aq 2 
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and let the mean-free path I be 

I > a. 

Therefore, the new spacial volume after 1 collision would be: 
V' = Aq[ ■ I ■ 2Aa (in 2D) 
= A q [.2l Aq2 



V ■ 
a 



a 

21 



where V = the initial volume = Aq\Aq2- In (^-dimensions then: 



a ) 

Now Louiville's theorem tells us that the momentum-space contribution to the 
phase space volume must decrease by a factor of (Ij)^ ^ N after N collisions. 

Problem - "The Butterfly Effect" : After iV collisions, a simple volume in phase space 
has been transformed into spaghetti in momentum space with typical dimensions 
given by 



Pn 

Example: Consider a classical gas of hard spheres of radius a and number density n. 

I ~ (na 2 )- 1 



a 
1 

-3 



~ ncr 3 = n* <r- dimensionless density 



ps 10 for typical gas 
For 3 dimensions and 3 collisions (D = 3, N = 3): 

APN (KT 3 ) 2 ' 3 = 10- 18 



Pn 

So we would have to keep this accuracy to track the particles accurately. Thus, after 
a few collisions, a ridiculous level of accuracy is needed to maintain the spaghetti 
structure. 



Remark 1: Consider a real experiment, where we will be looking at the effect of gravita- 
tional attraction between an external butterfly and our system. 

F GM „M 
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The momentum uncertainty due to F is: 

Ap = Ft 

where r is the mean free time between particles. 

I 

T = - 
V 

^Ap^(Ft\(F 
p \mv J \m 

For a classical gas: v = 10 3 m/s, r ~ 1CT 9 s. 



v/ 



~ 10 — ^ 

p r z 



• If the butterfly is m = 1 gram and r = 100 m. 

10 -22-7 = 1Q - 



^ ^ io~ 22 - 7 = io- 29 
p 

We know spaghetti structure is destroyed after 

Ap N / a \(d-i)N 



: 



Pn ^2// 
Setting ^ = and solving for TV yields: 

N = 5 

Thus, after only 5 collisions, the butterfly outside will affect the spaghetti 
structure of the system inside. 

If instead the butterfly (still m = 1 gram) is on the star Sirius (r = 8.5 
light-years or 8 x 10 16 m): 

— = io~ 22 ~ 35 = 10~ 57 
p 

=> N = 9 collisions (which takes about 100/xs 

So again, we are screwed up even by butterflies on Sirius! Now, in order 
for the "picture" to reappear in the recurrence relation, the spaghetti 
structure must be conserved. Thus, uncontrollable forces in the micro- 
scopic world destroy spaghetti structure. 



Remark 2: If, instead, we were to consider a computer experiment, we would be free 
of outside effects, but would instead introduce uncontrollable perturbations in the 
form of rounding errors. 



Conclusions: 
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1. Microscopically deterministic descriptions of N-particle systems over 
macroscopic times (with time reversibility, Poincare's theorem, etc) are 
impossible due to uncontrollable weak forces. 

2. In experience, time average of macroscopic quantities are independent 
of the instabilities in phase-space structure. 

3. We must develop a statistical, rather than deterministic, description of 
many particle systems. 

Remark 3: According to Boltzmann, the recurrence of states are fluctuations, which are 
certain to occur if you wait long enough. Thus, recurrence relations are completely 
consistent with a statistical viewpoint. 



1.2 Statistical Methods 
1.2.1 Probability 

Definition 1: Consider a set S / which is the set of all possible outcomes of an experi- 
ment. This is called the sample set. 



Definition 2: Let E be any subset of S. E is called an event and satisfies: 

1. E C S VE 

2. VE 1 ,E 2 C S, (Ei U E 2 ) C S A (Ex n E 2 ) C S 

"For events E\ and E 2 that are both possible, then E\ or E 2 must also 
be possible, as well as E\ and E 2 being possible." 





^ — ^ s 


( E1 ( 


) E2 ) 





/ — s 


( E1 \ 


I E2 I 



3. EcS, S/E c S 
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Definition 3: Each event is assigned a statistical weight or probability P(E) so that: 

1. < P{E) < 1 V£ 

2. P{E 1 U E 2 ) = P{E 1 ) + P(E 2 ) - P{E X n E 2 ) 

3. P(S) = 1, P(0) = 

Example: We will consider rolling a fair die: 

S = {1,2, 3, 4, 5, 6} 
'£7=1, 

Any £ C S is an event ^ P = {1, 3, 5}, 



P(E) = 



etc 

(number of elements in E) 



Proposition: The probability of mutually exclusive events equals the sum of the individual 
probabilities. 

Proof: If you have mutually exclusive events, then E\ n E 2 = 0. Thus 
P(Pi U Eh) = P(-Ei) + P(E 2 ) - P{E X n E 2 ) 

v ' 

o 

= P{E 1 ) + P(E 2 ) 

Definition 4: Let E\ and E 2 be events. The joint probability of E\ and E 2 is defined as 

P{E U E 2 ) = P(E 1 C\E 2 ) 

Definition 5: If E\ and E 2 are statistically independent, then 

P(E 1 ,E 2 ) = P(E 1 )P(E 2 ) 



Example: Probability of getting either a 1 or a 6 in rolling 1 die once? The events are 
mutually exclusive, so 

P(1U6) = P(1)+P(6) = 1 + 1 = 1 



Example: Probability of getting a 1 and a 6 when rolling 2 die once? 
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Also 

,S = {(1,1), (1,2),..., (1,6), 
(2,1),(2,2),... 

(6,1), (6, 2),..., (6, 6)} 

All possible events are equally likely. Odds are 2 out of 36 possible 

2 1 
36 ~ 18 

Remark 1: It is non-trivial to determine whether events are statistically independent! 
Definition 6: A probability distribution is the set of probabilities Pj so that 

i 

A quantity given by a probability distribution is called a random variable . 
1.2.2 Binomial Distribution 

Theorem: Let there be S independent attempts, and let the probability of a certain event 
in each attempt be p. The probability of an event occurring n times is: 

p b (n,s)=(^Jp n (l-p) S - n (*) 

where 



x n J n\(S — n)\ 

Proof: The number of ways to partition n events and (S — n) non-events (out of S 
total attempts) is 

S 
n 

And so 

Pb(n,)= Q/)*(n,S) 

where p* is the probability of realizing a particular partition. The probability for 
an event is p; thus the probability for a non-event is (1 — p). Thus 

P*=p n (l-p) S - n 
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Remark 1 : is called the binomial distribution . 
Remark 2: 

s s 



£*(n,^ = WV(i-p) 5 - B 



n=0 n=0 

Recall from the binomial theorem that 



(x+y) n = J2 (i) xk y 



k=0 

Thus 

s 



Y J Pb(n,S) = (p+l-p) i 



n=0 



1 S 



= 1 



Remark 3: Looking at an equivalent type problem, consider sites or boxes occupied with 
either or 1 indistiguisable objects. Picking S sites, what is the probability of 



finding n objects on the S sites, where on average n = m? 

Pb (n,S-m)=Q (f) n (l"|) 5 n 

_ S\ m n (S - mf- n 
~ n\(S-n)\ SS 



1.2.3 Poisson Distribution 

Proposition: A continuum of positions can be occupied by indistinguishable objects. Let 
the average number of objects in any sub-region by m. Then the probability of 
finding n objects in that sub-region is: 

pJn; m) = — l m a e~ m 



This is the Poisson Distribution. 
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Example: Consider a Geiger counter subject to constant radio activity. The probability of 
n clicks/sec if, on average, there are m clicks/sec, is given by a Poisson distribution. 
(Let the number of boxes go to infinity while keeping the density constant.) 

Lemma - Stir lings Formula: For n » 1, 

n! = V2^in n e- n [l + 0(±)] 
This can also be written: 

Inn! = ralnn - n + \ ln(2vrn) + 0(\) 
Proof: See Reif Appendix A6 



Proof of Proposition: By §1.2.2.R3, 

p b (n,S;m] 



m n (S — m) 



S-n 



n\(S-n)\ 

Let S — > oo while keeping n, m fixed. Then 

Pp = Pb(n, S — > oo; m 

Consider 

S\ (S - mf - ' 



s s 



In 


nipt 


= lim In 




m n 


S->oo 



(S-n)\ 



S s 



n) 



lim [In SI - \n(S - n)\ + (S - n) In (5 - m) - S In S\ 

S^oo 

lim [SlnS - S + \ ln(2vrS) + 0(\) -(S-n) ln(S - 

+\ ln(27r(5 - n)) + 0(^ + (S - n) ln(S - m) - SlnS 
= lim [| Ih(2tt) + ^ ln(S) - SlnS- Sln(l - 5) + nlnS + nln(l - 
iln(2vr) - ±lnS- ± ln(l - §) + SlnS + Sln(l - f] 



-n 



— nlnS — nln(l 
lim [n — n — m + 0(4)1 



m 
S 



+ 0(4 



—to 



n\ 

1.2 A Averages and Fluctuations 

Let p(n) be a probability distribution for some event to occur n times. Let f(n) be some 
function of n. 
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Definition 1: 

(f(n)) p :=Y,f(n)p(n) 

n 

is called the average or mean of f{n). 
Remark 1: (f(n)} is independent of n. 

Remark 2: Averages are denned with respect to a particular distribution. 
Remark 3: Choose f(n) = n m : 

{n m ) = Y^n m p(n) 

n 

This is called the m th moment of the distribution of p(n). 

Remark 4 : The zeroth moment is 

(n°) = (1) = y~] p(n) = 1 by normalization 

n 

Example: The first moment of p p (n;m): 

1 

n=0 n - 
oo 1 

n=l v ; 
oo 1 

E 1 

n . 

v- 



rt=l 

oo 

1 n+l m -m 
n! 

n=0 

oo 

I 

n 



m 

n=0 



= m 

which agrees with the definition of the Poisson distribution! Yay! 
Definition 2: 

• ((An) 2 } =((n-(n)) 2 } is called the mean squared deviation, the variance , 
or the 2nd moment abouth the mean of the distribution. 
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• (An) := ((An) 2 ^ 1 ' 2 is called the root mean squared (RMS) deviation or the 
standard deviation . Common notation has a = An and it gives us a measure 
of the width of the distribution. 

• is called the relative fluctuation . 

(n) 



Example: The 2nd moment of p p (n;m) is: 

oo ^ 

(n 2 ) =Yn 2 - y m n e- m 

\ ' Pp /-^ 77,1 
n=0 

( n + 1 )^n 



oo 

-m ' 

n\ 

n=Q 



in, ■■" ; — 



= me~ m (me m + e m ) 



m 2 + m 



An=((n-(n)) 2 )^=(<n 2 )-(n) 2 ) 1/2 
= (m 2 + m — m 2 ) 



Remark 5: For large numbers of events, the size of the expected deviations from the 
mean, measured in units from the mean, goes to 0. In other words, the distribution 
becomes sharply peaked. This is known as the Law of Large Numbers. 

1.2.5 Continuous Distributions 

Definition 1: Let x be a continuous random variable, and let p(x) be the probability 
density that the variable has the value x. Then p{x) dx is the probability that the 
value will lie in the interval between x and x + dx. Let J p(x) dx = 1. Then p(x) 
is the (continuous) probability distribution function. 



Definition 2: Moments, etc are defined by generalizations of §1.2.4. 

(x n ) = J x n p(x) dx nth moment 

1 /2 

a = Ax: = ((x 2 ) - (x) 2 ) RMS Deviation 

Example: A factory produces resistors with a nominal resisitivity of R. Actual resistivities 
will be distributed according to some distribution function p(R). 
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Remark 1 : We can always return to discrete values of the random variable by considering 
5- function distributions. 

Example: Suppose x can take on only integer values between 1 and N with equal proba- 
bility. 

1 N 

n=l 

is a continuous distribution function describing the above situation. 

j P {x)dx = l 

N 



j xp(x) dx = — ^2 I xS(x — n) dx 
^ n=i J 

1 N 



71=1 ' 

N 

n 

n=l 

1 :§^+i)) 



= 1(^ + 1) 

1.2.6 The Gaussian Distribution and the Central Limit Theorem 
Definition 1: Let x be a random variable with distribution 

PG(x) = -^=e'* 2 ^ 2 
Then pg(x) is called a Gaussian or normal distribution . 

Remark 1: (x) = 0. This can be trivially generalized by making the following substitution 

x — > x — (a;) 
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Remark 2: a is the standard deviation of pa- 

1 



x 2 ) = — )= I x 2 e- x2 ' 2 ° 2 dx 



Scaling x — > \[2ox 

= —^—2a 2 V2a [ x 2 e~ x2 dx 



a 



1 ,- 

2 



Lemma: The moments of the Gaussian distribution are: 



<*»> = 







if n = even 



if ii odd 



Proof: 



^x 2n+1 ) = by symmetry 

1 /*oo 

1 / N2n+1 f 

= —= (V2a) 2 / 



Now, looking at 



recall that 



x 2n e~ x dx 



f 

Jo 

[•CO 

\Z) = / IT 1 

Jo 



Letting t = x 2 , we see that 



f 

Jo 



x 2n e~ x dx 



poo 

Jo 



e~ l dt 



oo 

l t n+z-l e -t dt 



§ r (»+§) 



<x-> = ^=(V2.) 2 " +1 .2.ir(n+I) 
= ^-{2a 2 ) n T(n+\) 
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Since T{z)T{z+\) = ^^l 

(2<7 2 )™ ^T{2n) 



yfR r(n)2 2ra " 1 
2 n (j 2n (2n-l)! 

2 2n-l( n _ !)! 

, | 2y a2 „(2„, ! „ 



4/ 2n n! 

a 2 ™(2n)! 
2 n n! 



Definition 2: The characteristic function f(x) of a distribution p{x) is defined as: 

(ie. the fourier transform of p(x)) 
Lemma: For a gaussian distribution 

f(k) = e- k2 ° 2 / 2 , p(x) = f ^f(k)e ikx dk 

(since the fourier transform of a gaussian is a gaussian). 
Proof: 

ikx\ 

P 

■ikx) n 



f(k) = (e J 



n=0 * ' P 



= E 

n=0 

_ ^ / {-ikx) 2n 

-^\-(2^r, ; . 



00 f i\ni,2n 

E l-^ fc / T 2n\ 
(2n)! ^ ; 

(-l) n fc 2n (2n)!a 2n 
(2n)! 2 n n! 



n=0 

00 

= E 

n=0 

00 

= v 

^ n! 

n=0 
= e -fc 2 ^ 2 /2 
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f(k)e ikx dk 



2vr 



= to J 



2 /2 ikx 



2vr 



exp 



-:r 2 /2a 2 



-cr 



dk 
to 

2 f 2i 



k ^kx j H t 



exp 



exp 



a 



k - 

dk 
to 



IX 



(7 



dk 



-fc 2 /2<7 2 J_ ^2 

2vr a 



~ k2 dk 



1 1 



-fc 2 /2a 2 



'too 
p(k)c 



dk 



Theorem: Central Limit Theorem: Let Xi (i = 1,... , iV) be iV independent random 
variables with (xj) = Vi and (x 2 ) < oo Vi. Also let y = ^ Z)i=i x « be the 
arithmetic mean (ie. the average with respect to a flat distribution) of Xi. Then, 
for N — > oo, y is gaussian distributed with a standard deviation of a ~ 

P(y) = -U-* 2 /- 2 

cr\/27r 



with 

1 N 

a 2 = — V/~ 2N 



Remark 3: According to the law of large numbers, for large numbers of events the distri- 
bution is sharply peaked about its mean. And the CLT (Central Limit Theorem) 
tells us that the distribution in that limit is gaussian. 

Remark 4-' This holds irrespective of what the distribution of x is, so long as (x 2 ) < oo. 

Remark 5: Generalizing to (xi) / 0: 

-{y-(y)f)/2o 2 _ 

with 

1 N 

* 2 = ^£<>*-^>) 2 )) 

1=1 



p(y) 



exp 
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Simple Proof of Theorem: 

-iky 



= ^exp [ -/ 

/ N 
\i=l 

N 
i=l 

/ N 

exp In If (' ifeB< V 

\i=i 

JV 

exp ^ In (e~ ikXi ' N 
i=l 



since independent Xj's 



exp 



A? 



.i=i 



where 



^(p) = ln(e-^ 
Now, for N — > oo, we expand: 



A: 



In 



2^<*?> + 0(^) 



e ^ ) = exp 



1=1 



where 



1 N 



TV 2 



i=i 



By the Lemma then, p(y) is gaussian where: 



p(y) = 



with 



- 2 = ^E«> 



i=i 
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Finally, let 
Then 



X = sup{(xf)} 



x_ 

N 



Example: By §2.2, we have a binomial situation of S total events with: 



r^- 



Consider 



1 with probability p 
with probability (1 — p) 

p(m) = p5(ni - 1) + (1 - p)S(rii) 
s 

i=l 

so that n obeys a binomial distribution. Then 

p{n)=p h {n-s)= ( S \ N {l-p) S - n 



1 S 

("»> = n^2 n i=P 



i=i 



n 
S 



1 S 

=P SmCe n i = {°> !} n i = n * 



CLT says (5) is gaussian distributed as S" gets large: 



p(5) 



a-V2vr 



exp 



2a 2 



where 



- 2 = ^£(<- 2 >-<<) 
i=i 

= |d-P) 
:= S 

a 2 =p(\-p) 
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Changing variables: 



p Q d Q =p{n)dn 



P(n) = \ P Q) 



1 



1 



exp 
exp 
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Let a = \/~Sa: 



exp 



-("- ( n )) 
2S 2 a 2 

<n-{n)f 

2Sa 2 



-(n — (n)Y 
2~u 2 



d 2 = sa 2 = Sp(l-p) 
And we see that n is indeed gaussian distributed. 

1.3 Review of Thermodynamics 

1.3.1 Statistical Description of Large Systems 

Problem: From §1.1.5, we saw that for macroscopic systems (~ 10 23 particles), we can 
not solve deterministically by solving the equations of motion, even if this were 
desirable. 

Solution: Distinguish between a system's microstate, which is classically given by a point 
7 G T (Quantum mechanically, this is a stationary state given by a many body 
wavefunction Vl/(xi,X2, . . . , x W 23)) and its macrostate, which is specified by values 
of certain macroscopic parameters (ie. energy, temperature, pressure, etc.). 



Definition 1: 

• For a given energy E, the number of microstates whose energy is < E is denoted 
by Q(E) and is called the integrated density of states or the total number of states . 

• The density of states is 

dn(E) 
dE 



co(E)-,- 



which is the number of microstates per energy interval at a given point in 
energy space. 

^n(E) =u(E)dE 

where Q(E) depends on the size of dE, but oj(E) is independent of the incre- 
ment size. 
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• For a system whose energy is constrained to the interval [E — AE,E], the 
number of microstates with energies in the interval are denoted by Qae(E), 
and is called the number of accessible states . 

PA 




Figure 1.4: Example with Classic Harmonic Oscillator 



Remark 1: For macroscopic systems, any reasonable choice of AE has Q,(E) ps £Iae{E) 
to tremendous accuracy. Thus it is often unnecessary to distinguish between Q(E) 
and Qae(E). 

Remark 2: For large systems (N particles, N » 1), Q(E) increases exponentially with 
N, and for fixed -j| = const, then £l(E) and ui(E) are rapidly growing functions of 
energy. 

Remark 3: The goal of a statistical description is to determine probability distributions for 
the values of an observable system that is characterized by certain macroscopically 
defined conditions. 



pip) 




(p) 
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1.3.2 The Equilibrium State 

Definition 1: A system is isolated if it can not exchange energy with its surroundings 
(except for infinitesimal perturbations due to the butterfly effect). 

Remark 1: A completely isolated system would, in general, behave very differently from 
the realistic "isolated" system above. 

Definition 2: A system is in equilibrium if the probability of finding the system in a 
particular microstate does not change with time. 

Remark 2: In equilibrium, all probability distributions are time independent, and thus 
all average values of observables are time independent as well. However, the actual 
values still can fluctuate (equilibrium is not a static state). 

Postulate of Equal a priori Probabilities: An isolated system in equilibrium is equally 
likely to be found in any of its accessible states. 

Postulate - An Approach to Equilibrium: An isolated system that is not in equilib- 
rium will approach equilibrium if left undisturbed for a sufficiently long time. 

Remark 3: The above postulate would be false for truly isolated systems. 

1.3.3 Interacting Systems 

Two systems that are in contact with one another but isolated from the rest of the world 
can exchange energy in the form of heat (Q) and/or work (W). Thus the energy of each 
subsystem is not fixed. 




Definition 1: The average energy of a system that is a subsystem of a larger isolated 
system is called its internal energy, and is denoted by U = (E). 
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Remark 1: If a system absorbs heat Q and does work W, then its internal energy changes 
AU = Q-W. (1st law of thermo) 

Remark 2: If the change is infinitesimal, then 



where dU is an exact differential while 5Q and SW are not. 

Remark 3: AU depends only on the systems initial and final states, while Q and W also 
depend on the process that takes the system from the initial to final state. 

1.3.4 Reversible vs Irreversible Processes 
Definition 1; 



Remark 1: Let fij and Qf be the initial and final number of accessible states in a process. 
For processes that are adiabatic and quasi-static, $7j = and are thus reversible. 

Remark 2: Let x be an external parameter and let E n (x) be the energy of the n th 
microstate as a function of x. If x changes quasi-statically, then the sytem does 



dU = SQ- 5W 



• A quasi-static process is one that is infinitesimally slow enough so that the 



system remains in equilibrium at all times. 

• An adiabatic process does not involve heat transfer. 

• A reversible process is both quasi-static and adiabatic. 



work: 




where 




and is called the generalized force conjugate to x. 



Example: If the system volume changes by an amount dV, then work is done: 



SW = pdV, 



with p = — 



( 



dE 
dV 



> 



where p = pressure is the generalized force conjugate to the volume. 



Example: The infinitely slow compression of a gas in a thermally insulated cylinder by a 
thermally insulated piston is reversible. 
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Definition 2: An irreversible process is one that increases the number of accessible states 
such that Qf > fti. 

Remark 3: f2/ > fij implies that the final state has a higher probability and thus the 
system will not spontaneously return to the initial state. 

Example: Humpty Dumpty or the free expansion of a gas into a vacuum are examples of 
irreversible processes. 



1.3.5 Energy, Temperature, and Entropy 

Consider a "small" system (1), and a "large" system (2) that are in thermal contact. Let 
their energies be E\ and E2 and the total energy Etot = E\ + E2 and their number of 
accessible states are Q\ and f^. Let E\ = E, then the total number of accessible states for 




the whole system: 



Qu*(E) = Sl 1 {E)Sl 2 {E tot -E) 
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Remark 1 : The total number of states for the whole system is 

&>tot = ^2 ^tot(E) 

E 

and the probability distribution for E is 

n tot (E) 



p(E) 



tot 



Remark 2: Recall from §1.3.1.R2, we expect fltot(E) to be sharply peaked about (E) = U, 
the internal energy of system 1. 

Definition 1: A system's entropy is given by: 

S := k B In (Sl(E)) 
where k B = 1-38 x lCT 23 -^ = Boltzmann's constant. 

Remark 3: For two combined systems, £1 = 0,1^2 S = S\ + S2, and thun entropy is 
additive. 

Remark 4 : The entropy change for any process that takes an isolated system from one 
macrostate to another is positive semi-definite: AS > 0, where the equality only 
holds if the process is reversible. 

Definition 2: The temperature, T, of a system is defined as 

d(lnfi) 



\_ _ dS_ 
f~dE 



= k B 



E =u 9E 



E=U 



Also, let 

0:-. 



Remark 5: For two systems in equilibrium, the equilibrium state (most probable) occurs 
when 

tti(E)Q(E tot — E) 
is maximized. Which also implies 

S 1 (E) + S 2 (E tot - E) 

is maximized. Taking the derivatives to find the max: 

A 1Sl ( £ ) + S2(£ «- £ ,] = §§-§=0 
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in equilibrium 



Remark 6: If x is the value of some external parameter, then let Q(E, x) be the corre- 
sponding number af accessible states. Then the generalized force conjugate to x is 
given by 

lfllnfi 



F = 



/3 dx 



Remark 7: The relation between temperature, any external parameter, and the general- 
ized conjugate forces, 

T = T(x,F) 

is called the equation of state. 

Remark 8: Knowledge of £l(E,x) or, equivalently, S(E,x) = kg In Q(E, x), is sufficient 
for calculating all the thermodynamic properties. In particular: 



dE 



E=U 



1_ _ as 

f ~ dE 



E=U 



1 <91nf2 



dx 



= T — 

x={x) dx 



x=(x) 



1.3.6 The Laws of Thermodynamics 

First Law: 

• For an isolated system, U is a constant. 

• If a system is brought from one macrostate to another by a process that causes 
the system to absorb heat Q and do work W, then the internal energy changes 
by AU = Q - W. 

Remark 1: The first law simply expresses energy conservation. 

Second Law: 

• For any process that can take an isolated system from one macrostate to an- 
other, AS > 0. 

• A quasi-static process during which a system absorbs an infinitesimal amount 
of heat 5Q gives an entropy change dS = ^? . 
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Remark 2: dS is an exact differential, but 5Q is not. 

Remark 3: The 2nd law has profound technical consequences, which will be covered later 
in the semester. 

Remark 4-' Combining the first and second laws gives 



Third Law: S{T -> 0) -»• (Also called Nerst's Law) 

Remark 5: Dropping the distinction between Q(E) and ^Iae(E) is not compatible with 
the 3rd law. More generally, entropy can not be defined in a classical context (more 
on that later!). 

1.3.7 Thermodynamic Potentials 

Definition 1: In addition to internal energy, we define: 

• Enthalpy : H = U + pV 

• Helmholtz Free Energy : F = U -TS 

• Gibb's Free Energy : G = H -TS 

Remark 1: These are obtained from Legendre transforms of the 1st law. For example: 



dU = TdS-5W 



If the work done is purely mechanical, then 5W = p dV 



=> dU = TdS -pdV 



dU 



= TdS-pdV 

= TdS - d( P V) + V dp 

= TdS + Vdp 

= dH 



d{U + pV) 



Similar transforms give F and 



G. These give the differentials: 



dH 



= TdS + Vdp 
= SdT-pdV 
= -SdT + Vdp 



dF 



dG 
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Remark 2: These relations imply 



dSj p \dS /v 



p 



(dF\ _ (dU\ 



etc. They also imply Maxwell's Relations : 



dp \ 


(dS 




\dV 


f) = 


fdV 


d PJs 


\dS 



Remark 3: The specific heats are given by: 



.SQ\ _ T fds\ fdu 

( > \dTj- 1 \dT)-\dT 



v 



*9.\ =T (?S\ (9H\ 
dTj p \8T) p \dT) p 



1.3.8 The Simple Example: The Ideal Gas 

A monatomic ideal gas with N particles has equation of state: 

PV = nk B T = nRT 



It has internal energy 
and specific heat / mol: 



U = ^Nk B T 

C V = 3 -R 
C P = 7, R 

Note that these are only valid for monatomic gas. Now, a quasi-static change from (Tj, Vi) 
to (Tf, Vf) gives an entropy change of: 

AS = nC v In (J^J + nR In ^ 

Remark 1 : All of this can be derived from 

Q(E) = V N X (E) 
where x(-E') is not an explicit function of V . 
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1.4 Statistical Ensembles 

1.4.1 Gibbsian Ensembles 

Consider a system in a particular microstate. 

Definition 1: A statistical ensemble consists of many identical systems (same number 
of particles governed by the same equations of motion) that are all in the same 
macrostate but, in general, in different microstates. 

Remark 1: This concept makes averaging easier since we can average over members of 
the ensemble at a given time rother than following the time evolution of a syngle 
system and averaging over long time periods. 

Example: Probability of getting a 6 when rolling 1 die once. You can either roll one die 
many times, or roll many identical dice at once. 

Remark 2: Need to find the probability of a member of the ensemble to be in a certain 
microstate. This depends on the physical situation. 

1.4.2 The Microcanonical Ensemble 

Consider an isolated system in equilibrium whose microstates have energies 

E(p, q) f° r the classical case, or 



Define a macrostate by demanding thath the energy lies in an interval [E — AE, E\. 
Theorem: The probability of the system being in the microstate with energy E(p, q) or 



E n , 71 = 0,1,... 



for the quantum mechanical case 



E n is: 





where the integral is taken over the region where E — AE < E(p, q) < E and 
7 = (P, q), dj = dpdq, T = {7} 





Proof: Follows from §1.3. 2. PI 



Remark 1: 





n 
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And so our normalization is ok. 

Remark 2: This ensemble is called microcanonical and (*) is called the microcanonical 
distribution function. It is appropriate for isolated systems. 

Remark 3: Microcanonical ensembles lack an obvious temperature concept. 
1.4.3 The Canonical Ensemble 

Definition 1; A heat bath is a system that is large enough so that any heat that is 
absorbed or given off by the heat bath in any thermodynamic process is negligible 
compared to its internal energy. 

Definition 2: The canonical partition function, Z, is defined quantum mechanically as: 

n 

and classically, for a system with N particles and 3iV degrees of freedom, as: 

h? N N\ J e 7 



Remark 1 : The uncertainty relation implies that the phase space can not be partitioned 
into cells smaller than ApAq = h. Thus the factor of h 2N in the classical definition. 
We'll discuss the origin of the N\ later. 

Remark 2: A more general definition of the partition function which holds classically and 
quantum mechanically is: 

Z= / u{E)e-? E dE 
Jo 

where oo(E) is the density of states. 



Theorem: For a system that is in thermal contact with a heat bath, the probability of 
being in a microstate with energy E n (QM) is: 

Pa = (**) 

or classically: 

PE = wmz e ~" E ( ** } 
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where (3 = -^Kp and T is the temperature of the heat bath. 

Proof (QM only): Let 1 = system and let 2 = heat bath. Thus we have that 1 is 
in a state with energy E n , and 2 has energy E 2 . Thus, the combined system has 

Etot = E n + E2 

= constant by 1st law 

By §1.3.2.P1, we have that 

p n = (const) 0, 2 (E tot - E n ) 



p n = (const) exp 



S 2 (E-, 



tot 



E„ 



k B 



Because of the heat bath, E to t 3> E n , so: 



dS 2 



dE n 



p n = (const') exp —E n 

= (constOe - ^" 
Normalization implies 

(const') = (5>-^ 



k B 



+ ■ 



Remark 3: This is called a canonical ensemble and (★★) is a canonical distribution or a 
Gibbs-Boltzmann distribution. 



Remark 4 : The canonical distribution also applies to situations where the system has 
been prepared so that its energy is not known precisely but the average energy, U, 
is known. In this case, T is the temperature a heat bath needs to have in order for 
the average energy to remain U if the system is brought into contact with the heat 
bath. 



Remark 5: The energy of a system in contact with a heat bath is not fixed, but is subject 
to fluctuations. How big are these fluctuations? 

Lemma: In a canonical ensemble, the mean energy and the rms energy fluctuations are 
determined by the partition function via the following relationships: 
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Proof: 



Thus 



And 



(AE) = ((E - (E)) 



L! \i/2 (3 2 In 1/2 



9/3 2 



ainz i 



a/3 zap 

n 

= ^ E n p n 

n 

= (E) 



d 2 lnZ d 



d(3 2 dp 



-/3E n 



n 

' n n 



J_ fdZ_ 

'z 2 \dp 



fiE n 



~{E) 2 + {E 2 ) 
(AE) 



Remark 6: The heat capacity, Cy = (ff) 



v 



Cv = -t\M) v = t^ 



Remark 7: For a macroscopic system with N particles at temperature T, 

U = O (Nk B T) 
C v = (Nk B ) 



Proposition 1: The energy fluctuations in a large system described by a canonical en- 
semble are gaussian, and the relative energy fluctuations are: 

AE o 
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with N equalling the number of particles. So the fluctuations are small, and thus 
we need only worry about the averages. 

Proof: Consider a large system, and divide it up into n identical subsystems that 
are each still macroscopic (and n 3> 1). Let each subsystem have energy Ei, (i = 



n 



1, . . . , n). Thus, the total energy of the system is: 

n 

Etot = E Ei 



i=l 



Due to fluctuations, Ei are random variables that obey the canonical distribution. 
Thus each subsystem has a canonical partition function: 



m 



-/3E, 



(0 



(i) 

where Em is the energy of subsystem number i. The subsystems are identical, and 
thus Zi = z. Thus, the partition function of the whole system can be written: 

Z = z n 

The canonical distribution has a finite variance, and hence CLT applies. By §1.2.6, 
we have: 

Xi = nEi (i = l,...,n) 

y = -i^^ = E 



n 



i=i 



1 



p( E ) = — 7^F= exp 



aV2ir 



jE-{E)f 
2a 2 



with 



By the above Lemma: 

2 ndHnz dHnZ 2 T 
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(AE tot ) 2 
(E) 2 ' 



TP ~ ipp 



C v = 



T k B T 
Nk B TNk B T 



Nk B 





' 1 " 


= o 




N _ 



Remark 8: A macroscopic system has an extremely sharp gaussian energy distribution. 

Proposition 2: In a canonical ensemble, the Helmholtz free energy is given by: 

F = -k B TlnZ 

Proof: Let x be an external parameter that characterizes the system. Then the 
energy level E n = E n (x). 



If we change x, (3 quasi-statically by dx and dj3 respectively, then 
dlnZ 



By §1.3.4.R2: 



dlnZ in dlnZ , 

-dp H — dx 



dx 



-udp + W(-^ En{x) jr dx 



dx 



-Udp-p(j^- ) dx 



d{\nZ + UP) 



-Udl3 + (35W 
(3 5W-d(U(3) + (3dU 
p (5W + dU) - d(U/3) 
(3 (5Q) - d(U0) 

TdS-d(Uf3) 



k B T 
1 



k B 



dS 



U 



S = k B (In Z + /3U) = k B In Z + — (up to a constant) 



Thus by the definition of F: 



F = U-TS 
= — k B T In Z 



Remark 9: F, and therefore Z, determine all thermodynamic quantities. 
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Corollary 1: Up to a constant, 



S = k B In Z + k B T 



dlnZ 
dT 



Proof: By §1.3.7: 



S = ~=k B laZ + k B T^- 
dT dT 



Corollary 2:: 

Proof: Also by §1.3.7: 



p = k B T 



dlnZ 
dV 



P = — 7^77 = 77f7 (k B TlnZ) = k B T- 



dV dV 



dV 



1.4.4 The Grand Canonical Ensemble 

Consider System ® in contact with a heat bath (System ®): 




In this case, due to the perforated boundry, both heat and particles can be exchanged. 

Remark 1: The particle number iV is not fixed, and so the number of accessible states 
depends on both N and F. 

=>n = n(E,N) 



Definition 1; The chemical potential, fi, of a system is 

1 dlntt 



H := - 



p ON 



E=(E)=U 
N=(N) 
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Remark 2: —fin is related to TV as (3 is related to energy (§1.3.5.R8): 



P 



dE 



-Pn 



E=U 



01nfi| 

ON e=u 

1 N=(N) 



Remark 3: Many properties of f3 carry over to ^u. In particular, two systems in equilibrium 
with one another have the same fx. In addition, a heat bath will have constant 

Definition 2: Let E^ (n = 0, 1, . . .) be the energy levels of ® when it contains N parti- 
cles. The grand canonical partition function is defined as 



z= j2^ N J2 e ~ m 

N=0 n=0 



(N) 



Remark 4-' Here we restrict ourselves to quantum mechanics. 



Theorem: The probability of system ® being in a macrostate with N particles and energy 

1 



E&* is 



(eW - M iv) 

Proof: Generalizing §1.4.3, we have that 

E^ + E 2 = E t ot 



N + N 2 = Ni 



tot 



S 2 (E 2 , N 2 ) = k B In Q 2 [E tot - Ei N \N to t - N 
^k B lnQ 2 (Etot,N to t)-k B E^ 

= C- k B pE^ + k B Nl3fi 



dlnQ 2 



dE 



Etot ~ kbN ~mT 

Ntot 



Etot 
Ntot 



where C in an constant. Normalizing, we find that 
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Lemma: In a grand canonical ensemble, the thermodynamic potentials U, H, F, G obey 
the relations: 

dU = TdS -pdV + ndN, U{S,V,N) 
dH = TdS + Vdp + fidN, H(S,p,N) 
dF = -SdT -pdV + ndN, F(T,V,N) 
dG = -SdT + Vdp + fidN, G(T,p,N) 



Proof: Recall that 



H = ~k B T 



ON 



E=U 
N={N) 



But then 



dS 



dEj 



V,N 



E=U 



dS_\ 
dNJ 



1-dU+^-dV 
T T 



fi- 



dN 



dU = TdS -pdV + ndN 
Performing Legendre transformations, it follows that: 



dN 



u,v 



H = U + PV : 

F = U-TS 
G = F + pV 



dH = TdS + Vdp + fidN 
dF = -SdT -pdV + fidN 
dG = -SdT + Vdp + fidN 



Remark 5: fi is the energy change that results from adding one particle to the system 
adiabatically (dS = 0) and isochorically (dV = 0). 

Lemma 2: The Duham-Gibbs Relation: 

G = Nn 

Proof: By Lemma 1: 

G = G(T,p,N) 
We expect G to be proportional to N, and so we let 

G(T,p,N) = Ng(T,p) (*) 
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Now, again by Lemma 1: 



fdG 



) 



G 
N 




Remark 6: It is not obvious that (★) holds. See §1.4.5 for a discussion and derivation of 



defines a thermodynamic potential whose differential is 



This is called the grand potential. 

Proof: Perform a Legendre transformation from F = F(T, V, N) to J = F — fiN = 



j(r,v, M ). 

d J = dF - ii dN - N dfi 
= -SdT -pdV - Ndfi 

From Lemma 2 (G = fiN): 

J = F-fiN = F-G = F-{F + pV) = - P V 
We must still show that: 



(*)■ 



Proposition 1: In a grand canonical ensemble: 



J : = -k B TlnZ 



dJ = -SdT -pdV - Ndp 



which is also equal to 



J = -pV 



J = -k B TlnZ 



Now 




- exp [-0EW + /3»N 




^(e^In 
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S = k B (in^ (e^ n \N^ = - (inp^ up to a const 

= k b In Z + k B f3 (4^) " k BpH (N) 

Multiplying everything by (— T) yields 

-k B T In Z = TS + U - [i (N) 
= F- f i(N) 
= J 



Proposition 2: In a grand canonical ensemble, the mean particle number is given by 



e 

N n 

Proof: See HW. 

1.4.5 The Thermodynamic Limit and the Durham-Gibbs Relation 

Consider a macroscopic system, V = 0(1 cm 3 , N = 0(1O 20 ), which is huge compared to 
its microscopic dimensions of N ~ 0(l),V ~ O ^lA 3 ^. Recall that the free energy is 
F = F(T, V, N). 

Definition 1: The limit as V — > oo and TV — > oo so that n = y = C and / = y = C < oo 
is called the thermodynamic limit. 

Remark 1: For practical purposes, macroscopic systems are in the thermodynamic limit. 

Definition 2: 

• Consider a function of n variables, f{x\ , . . . , x n ) . It is a homogeneous function of degree a 
if the number o£l exists so that 

f(bx u . . . , bx n ) = b a f( Xl , ...,x n ) Vb > 

• / is a generalized homogeneous function if n + 1 numbers [x\], [X2], ■ ■ ■ , [x n ], [/] 
(not all zero) exist so that for all b > 

/(ft^Si, b^X 2 , b^X n ) = bWf(x!,X 2 , ■ ■ ■ , X n ) 



Examples: 
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1. If we have the case where n = 1, /(x) = cx a 

=> f(bx) = c(bx) a = b a cx a = b a f{x) 

=> homogeneous function of degree a 
If instead we had n = 1, f(x) = ln(x): 

f(bx) = In (bx) = In b In x 

=>- Not homogeneous 

2. Now consider when n = 2, f(x,y) = x 3 + xy + y 3 / 2 . Let's choose [x] = 

i, [y] = 2. 

^/(6Wx,6^y) = /(6x,6 2 y) 

= (bxf + (bx)(b 2 y) = (b 2 yfl 2 
= b 3 (x 3 + xy + y 3/2 ) 
= 6 3 /(x,y) 

=>■ /(x, y) is a generalized homogeneous function with [/] = 3. 
What is we hadn't known what [x] and [y] were? 

x 3 6 3[x] + ^N+Is/l^y + 6 3 [2/ ]/2 y 3/2 = ^3 + %y + y 3/ 2) 

=► [x] + [y] = 3[x] = l[y] = [/] 

So we basically have 3 equations, 3 unknowns. The solution will be unique up 
to a redefinition of b. As a counter example, consider: 

n = 2 : f(x, y) = x 3 + e y is not a generalized homogeneous function 

Consider now a d- dimensional system in the thermodynamic limit, and change all linear 
dimensions by a factor of b > 0. 

L ->• = t 
o 

v -> v 7 = £r d v 

Remark 2: Under this transformation, in order for n = y to remain constant, we must 
have 

N -»• iV' = ?T d iV 
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Remark 3: If the system is in contact with a heat bath, where the system is huge in 
comparison to the microscopic limit, and the heat bath is huge in comparison to 
the system, then T does not change upon changing volume. 

T T' = b°T 



Lemma: The Helmholtz free energy is a generalized homogeneous function of T, V, N, 
namely: 

F(T, V, N) = b d F (r, Vb~ d , Nb~ d ^ 
Proof: By Definition 1: 

= f (T, V, N) in the thermodynamic limit 
_ F(T,V,N) 
V 



F(T,V,N) = ^F(T',V',N') 



= b d F (T, b- d V, b- d N^j 



Remark 4 : [f] = —d, [V] = —d, [N] = —d, [T] = are called scale dimensions of 
F, V, N, T respectively. 

Remark 5: Let A and B have scale dimensions of [A] and [B]. Then [AB] = [A] + [B]. 

Lemma 2: There exists a function F(x,y) such that 

F(T,V,N) = NF (r,^ 

Proof: The value of b in Lemma 1 is arbitrary so long as it remains positive. Thus, 
lets let b = N 1 ^. 

=> F(T, V, N) = NF(T, N~ 1 V, 1) 
Define F (x, y, 1) : = F(x, y). 

^F(T,V,N) = NF (t,^ 
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Lemma 3: 



bn),, t + \dv]„ T 



Proof: By Lemma 2: 
dNJv,T 



Since 



ON J 



x=T 
y=V/N 



F T. 



V\ V fdF(x = T,y = V/N)\ 
dy J 



N N 



dF 



N- 



1 dF 



dN) VT N dy 



amS + v( aF 



V.T 



\8V 



N,T 



V 



XFl T,-) =F(T,V,N) 



Theorem: Again, G = /j>N by the Duham-Gibbs Relation 
Proof: By §4.4.L1 dF = -S dT - pdV + fidN. 



Now 



dF\ 

sv) T «'- 



G = F+pV 



W)t,n 

\dNj TtV 
UN 



dF\ 



'dF\ 

V[ m7l by above L3 
ov j TN 



Remark 6: The above proof did not use §4.4(*). (G(T,p,N) = Ng(T,p)) 



Remark 7: §4.4(V) can be obtained as follows: 

[F] = [V] = -d 
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b] 



~dF~ 




~ F~ 


8V 




V 



[F] - [V] = 



G(T,p,N) = -b-&G (TbW,pbW,NbW) 



= b d G{T,p, Nb- d ) 



Let b = N 1 ^: 



G(T,p, N) = NG(T,p, 1) : = Ng(T,p) 



where g(x,y) := G(x,y,l). Thus the proof of the Duham-Gibbs relation in §4.4 
was indeed true, just not obvious. 



1.4.6 Systems in Magnetic Fields 

In general, work is not purely mechanical for systems in magnetic fields. 

Lemma: A magnetization change dM by a magnetic field requires work 5W = B ■ dM. 

Proof: We want to magnetize the system by letting it approach the bar magnet 
from x = — oo. Let the field be axi-symmetric along the x-axis and B(x — > oo) — > 0. 



X = 


= a 
















System 









B 



c 

03 



CD 



Also let the final position by x = a. The attractive force at point x is: 

dB 



F = M(x) 



dx 



To do this process quasi-statically, we need a balancing force Fb a i ance = —F. So we 
want to apply force: 

dB 

F b alance{x) = -M{x) — 
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which does work 

J D 

Wi = - / Mix)— dx 
ax 



= - r m( S 

J — oo 

= -M(a)B(a) + / —B(x) dx (int by parts) 

1/ — oo 
/•Af(a) 

= -M(a)S(o) + / B(x)dM 
Jo 



To find the work it takes to magnetize the system in the absence of any other 
changes, we now take the system back to x = — oo while keeping magnetization 
fixed at a value M(a). This requires work. 

r — oo J r> 

W 2 = - M{a)^dx 

Ja dx 

= -M{a) [0 - B{a)] 
= M(a)B(a) 

So the total required work to magnetize the system is: 

r -M(a) 



pM (a) 

W = W 1 + W 2 = / B(M) dM 
Jo 



For an infinitesimal magnetization then, the amount of work done on the system is 

SW = B ■ dM 



Proposition: For a magnetizable system in a magnetic field, the free energy obeys 

dF = —SdT-pdV-B- dM + fx dN 

Proof: dU = 5Q — 8W = T dS — B • dM for purely magnetic work. The rest follows 
as before. 

Remark 1: By means of a Legendre transformation, F = F + B ■ M, one can switch from 
F = F(T, V, M, N) to F = F(T, V, B, N). Similar things can be done for the other 
thermodynamic potentials. 

1.5 Quantum Statistical Mechanics 

1.5.1 The Postulates of Quantum Statistical Mechanics 

Let a system at time t be in a quantum state \ip(t)}. Expand this state in a complete set 
of orthonormal functions {|<^ n )}- 

m)) =^C„(t)K), C n (i)eC 

n 
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Remark 1: \C n (t)\ is the probability for a system to be in state \ip n ) at time t. 
Remark 2: The time evolution of \ip(t)} is determined by Schrodinger's equation: 

ih®- t m)) = H\m) 

with H representing the systems Hamiltonian operator, and we assume H to be 
time-independent. A deterministic system would imply that if you know state 
IV'(O)), then you know the system's state at all future times. 

Remark 3: 

(ip m \lp{t)} = ^ C n {ipm\ip n } = C m (t) 



=> ihC n {t) = Lp n ih^{t)\ = (ip n H 
m 

■ = ^ ^ H nm C m (t) 

m 

where H nm are the matrix elements of the Hamiltonian. 

=> C n (t) = - H nm C n (t) 



m 
m 

= ^ ^ HmnC^t) 
m 



Here (<£>|^>) is a scalar product in Hilbert space and we have used the fact that H 
is hermitian. 

W = H =>■ #* m = i7 mn 

Let A be an operator in Hilbert space that corresponds to some observable A. From Phys 
515/516, we know thath the expectation of A in a state ip(t) is given by: 



a) = (^{t)\A\m) 

nra 

= Y J C* n {t)C m (t)A 



A 
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Remark 4-' The normalization of \ip(t)) implies that 

n 



Remark 5: (^AJ is the average value obtained for the observable, taken from a large 
number of simultaneous measurements on equally prepared systems. 

Remark 6: Quantum Mechanics implies an averaging concept even in the absence of 
statistical mechanics considerations. 



Remark 7: Due to the butterfly effect, we are never quite sure which state the system is 
in, and therefore we need an ensemble average. Thus the ensemble averaged values 
of (^Aj (which is now a random variable due to butterflies) is: 

(A)=J2(C n (t)C m (t))A nm 



For a deterministic quantum mechanical system, \ip(t)) describes a system for all time given 
|V>(0)). For example, let |^(0)> = + 2 \<p 2 ): 

d(t = 0) = 1 
C 2 (t = 0) = 2 

In 2 dimensional Hilbert space: 

<P2 



MO)) 




The butterfly effect means we are not exactly sure what the state of \ip(0)} is. 

=^ Ht t a i = H system + H system+butter flies 
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Definition 1: The density matrix or statistical operator of the system is defined as the 
operator p whose matrix elements are 

Pnm{t) = (<Pn\f>W m ) ■ = (C m (t)C*(t)) 



Remark 8: As in §4.1, the average above can be considered either as a time average for 
one system, or as an ensemble average at a given time. 

Proposition 1: Let p be the statistical operator of some system. Let A be an operator that 
corresponds to observable A. Then the ensemble average (aJ of the expectation 
value A of A is given by: 

(A) = tr (pA) 



Proof: 



^2^2 (<Pn\p\<Pm) 
n m 

^ ^ PnmA m n 
nm 

^2 (Cm(t)Cn(t)) A m1 
nm 

J2(Cn(t)C* m (t))A nv 
nm 

(A) 



A 



rr 



Proposition 2: The statistical operator obeys the Liouville - von Neumann equation: 

ihd t p(t) = [H,p(t) 

Proof: 



ihdtpnm = in [{c n (t)c^(t) + c n {t)c* m {t) t 

= J2 (H ns (C s (t)C* m (t)) - H sm (C n (t)C* m (t))) 

s 

= ^ ^ (H ns p sm — p ns H sm ) 

s 

= (Hp) - (pH 

\ / nm \ 

= H,p 
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Corollary 1: For a system in equilibrium, the density matrix commutes with the Hamil- 



tonian, 



H,p 



0. 



Proof: In equilibrium, p is not a function of time. 



OtPeq = 



H,p 



Corollary 2: In equilibrium, p, can depend only on the Hamiltonian and operators that 
commute with the Hamiltonian. (I.e. that correspond to conserved quantities.) 

Let ip n be energy eigenstates: 

Htp n = E n (p n 

Quantum mechanics tell us that, if A commutes with H, then <p n can be chosen so that 
they are eigenstates of both A and H. 

Corollary 3: In this basis, the density operator is diagonal: 

Prim = $nmPn 

where p n is a function of the E n and of the eigenvalues of any other conserved 
quantities that p depends on. 

Corollary 4: 

Liouville's Equation: -j-p(p,Q,t) = 



Postulate 1 - Postulate of Equal a priori Probabilities: For an isolated system in 
equilibrium: 

p n = p(E n ) 

with p n given by equation (*) in §4.2. 
Remark 9: "Isolated" means isolated up to the butterfly effect. 

Postulate 2 - Approach to Equilibrium: This is the exact same as done in §1.3.2.P2. 



Remark 10: Remaining job: to find the statistical operator for systems that are not 
isolated. 
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1.5.2 The Density Matrix for Various Ensembles 



Microcanonical Ensemble: By §5.1, the statistical operator in terms of its matrix ele- 
ments in a basis of energy eigenstates is: 



Pn 



! fl, E - AE < E n < E 



-cdot 



Yl 1 I 0, otherwise 



Canonical Ensemble: By §4.3, the correct matrix elements are given by: 

1 



-/3H 



with Z = tr (e-^) being the canonical partition function. We can also write 

Z = tr (e-^) 



-0H 



-E 

n 



tp 7 



-/3E n 



Grand Canonical Ensemble: By §1.4.4: 



where N is the number operator and 

Z = tr (e-^'-^' y 
is the grand partition function. We know that 

H |</?n,Jv) = E n \(p n: N} , N \if njN ) = N n \(p n ,N) 

And thus we can write Z as: 
Z = tv (e-W-^y 



n,N 
n,N 

= ^ e -P( E -n-» N > 
n,N 



-P(E n -nN n ) 



( Pn,N / 

ifn^N > since 



H,N 
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Remark 1: All thermodynamic quantities can be calculated from the partition function 
as before. In particular, in the canonical ensemble, we have 



Remark 2: Statistical mechanics, quantum or classical, then boils down to calculating 
partition functions. 

1.5.3 Fermions and Bosons 

Consider a quantum system consisting of N particles, which, for simplicity, we will take 
to be non-interacting. Let the single particle energy levels be denoted £ (n = 0, 1, 2, . . .). 
Each of the corresponding eigenstates can be occupied by 0, 1, 2, . . . particles. 

Postulate 1: Quantum particles come in two species: fermions and bosons. For fermions, 
at most one particle can occupy a given energy eigenstate, while any number of 
bosons can occupy any given energy eigenstate. 

Remark 1 : The restriction on fermions applies only to fermions of the same kind (eg, all 
electrons) whose quantum numbers are the same. 

Remark 2: The fermionic restriction is known as the Pauli Exclusion Principle. 



Remark 3: Fermions have half-integer spin, whereas bosons have integer spin. 
1.5.4 The Fermi-Dirac Distribution 

Consider a gas of N non-interacting fermions. Let the single particle spectrum be denoted 
{£ n ; n = 0, 1, . . .}, and consider the nth eigenstate (with energy £ n )) as the small subsystem 
under consideration. 




and in the grand canonical ensemble: 
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The number of particles in a state is N n , and thus the total energy of a subsystem in £ n N n . 
Also note that the system can exchange particles with other states, and thus the grand 
canonical ensemble is appropriate. Thus the partition function of the subsystem is: 

Z n = ^2 e l3fJ,Nn e~ l3£nNn 



= 1 + e P(V~£n) 

since N n = {0, 1} for fermions. We also have that 

J n = —ksThiZn 

= -k B T In [l + e /^-£n) 

which is the thermodynamic potential for the nth state. 

Proposition 1: The grand canonical potential for a system of non-interacting fermions is: 

J= -fc B T^ln [l + e 0(M-£n)' 
n 

Proof: J = J2n J n 

Theorem: The average number of fermions in the state with energy £ is given by 

1 



(N n ) 



l + e /3(S n -n) ■ 

and the chemical potential /j, is implicitly determined by the requirement 

Y,U£n)=N 

n 

where ./V is the total number of fermions. 
Proof: By §4.4.P2, we have that 

dfi J T V 

( p e 0*-P) \ 



(Nn) 



= k B T 



I _|_ e p(n-e n ) 



e -P{n-£ n ) 
1 

1 _)_ e P(S n -n) 



T = 
Ti > T 

T 2 >T 2 
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Fermi 
Sea 



£ 



particles 
don't have 
the energy to 
~ exceed the 
chemical 
potential at 
T=0. 



Remark 1: f^(£ n ) is the Fermi-Dirac distribution, and has the following properties: 

1. decreases monotonically with increasing energy 

2. = M ) = \ 

3. > M ) ->• 

4- / M (£)| T=0 = e( M (r = o)-£) 

Remark 2: fi(T = 0) : = £f is called the Fermi Energy. 
1.5.5 The Bose-Einstein Distribution 

Consider iV non-interacting bosons. The partition function for the nth eigenstate is 
Since bosons have N n = 0, 1, 2, . . . , oo, we have a geometric series. 



=>- J n = A; i3 rin(l-e /3(At -^ ) 
which is the thermodynamic potential for the nth state 
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Proposition: The grand potential for a system of non-interacting bosons is: 

n 

Theorem: The average number of bosons in the state with energy £ n is: 
and the chemical potential is implicitly determined by 



Proof: 



1 — e P(tl-£n) 
1 



oP{£ n — fi) — \ 



Remark 1: n^(£) is called the Bose-Einstein distribution . 

Remark 2: The geometric series (★) must converge for all energies £ n . In particular, for 
the ground state So = =>■ e 13 ^ < 1. But /3 = > =>• \i < for bosons. Thus, 
for bosons, the chemical potential is always negative. For fermions, the chemical 
potential can be either positive or negative (depends on temperature; for low temp, 
jj, > 0, see Fermi Sea). 

Remark 3: For e^ _£ ™) <C 1, both and n M (£) approach a boltzmann distribution: 

M£) \ = 1 = eK»- £ ») 

™m(£) J e/3(£„-/i) ± 1 1 -t- e P(n-£ n ) 

Also, — £ n ) <C and £ n S> /x since the energy of the state is higher that that 
of adding one additional particle. Thus the above can be further simplified to give: 
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Chapter 2 

Selected Applications 



2.1 Classical Systems 

2.1.1 The Classical Monotomic Ideal Gas 

Recall that a classical gas has 

N 2 

1=1 

= kinetic + potential 

Remark 1 : All interactions between gas particles and between gas and external fields are 
contained in U. 

Remark 2: Exclude charged particles in magnetic fields, so that U depends on positions 
only. 

Remark 3: For an ideal gas, there are no particle-particle interactions, and thus U = 
except for volume restrictions due to container walls. 



U(xi, ... ,x n ) 



if Xi € V 
oo otherwise 



From §4.3, we have an expression for our partition function: 
Z = J d Pl dp2... dp N j dx! dx 2 ... dx N e -PH\PiU*i}) 

IN "1 

fr 3 ^iV! / dPl ' ' ' dPN 6XP ~^ ^ 2m P ^ / dXl ' ' ' dXN 6XP ^~^ U ( Xl ' " " " ' Xn ^ 



i=i 



v , integral over 
integral over ... , 

° , positions only 

momentum only 
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In our case 



U 



oo 



h 3N N\ 

yN 



dpe 



-/3p 2 /2m 



N 



V 



N 



fr? N N\ 



poo "1 N 

- An / d PP 2 e-P p / 2m 
■ l Jo 



Let p 



h™N\ V P J [Jo 
(2mfc B T7r) 3Af/2 



4 



Integral Trick: Let 



da 



dx x e 



2 



where a = 1. Taking more derivatives can get you higher even powers of x. 
Now, taking the natural log, we have that 



lnZ = iVlnV + — InT+^lnf^^VlniV! 



3N 
~2 



2 -V V ) 
We can use Stirlings approximation on the factorial to give us: 



In Z = NlnV + ^ InT + ^ In {^^) - NlnN + N - \ In (2vriV) + O (1 



= iV 



In 



2 

v\ ;; 

iV 



Remark 4: Within purely classical mechanics, one would write: 
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where ho is some quantity with dimensions of action. Choosing ho = H is a plausible 
quasi-classical choice, but the ^ is completely ad hoc. So we'll now look to see if 
this term makes a difference. 

By Ch 1, §4.3: 

, _ dlnZ k B TN 

p = kBT = ^r = — 

=> P V = Nk B T 
So that works ok. What about the internal energy? 

TT -dlnZ 3N1 3 ATI m 

So the internal energy is also fine. How about specific heat? 

1 (dU\ 3 N 3 Ar , 3 n 

Still good! 

Remark 5: None of the above results depend on the ^ prefactor. 
Now, from Ch 1 §4.3, we have that 

F = -k B TlnZ 



5 = = A; B In Z + k B T-^r- 



dT 

k B lnZ + k B T 



3N 
2T 



= ^Nk B + fcelnZ 

depends on 
J_ 
AT! 



5 = fc B iV 



V\ 3 
ln|-)+-Inrao 



, 5 3,/ 2irmk B \ 

where ,„ = - + - In (-^ j 



Remark 6: So 5 (ioes depend on the -kj prefactor 
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2.1.2 The Gibbs Paradox 

Suppose we had omitted the -Ay prefactor. Then we would have a partition function: 



InZ = N 



lnF + ^lnT + ao- ^ 



where 5q = ctq — 1. The entropy in this case would then be: 



S = Nk B 



]nV + -InT + ao 



There is something wrong with this expression though. To determine what, we will con- 
sider the thought experiment of Gibbs. 



Assume we have an ideal gas with N particles in volume V. We insert a partition, creating 
two systems with y particles in each ^ volume. 

Remark 1: This is a reversible process, and thus S = Si + S^- 

So now 



S = Nk B 



]nV + -InT + ao 



And thus 



In 



V 



In T + (T 



= S-Nk B ln(2) 
< 5 

But this is a violation of what really happens!! 

Remark 2: This inconsistency of classical statistical mechanics is called the Gibb's Para- 
dox. 



Consider instead a mixed system: 
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Remark 3: Suppose we painted the molecules in the left and right compartments red 
and blue, respectively, before removing the partition. The mixing of red and blue 
would be irreversible, and thus S > S\ + §2- 

Remark 4-' Thus, the paradox arises from the indistinguishability of the particles. 




Figure 2.1: There are N\ ways to swap these particles, all of 
which contribute to only 1 microstate 



So Z counts the microstates that arize from the N\ possible permutations of the 
particles of different microstates. This is correct for distinguishable particles, but 
wrong for indistinguishable ones. For indistinguishable particles, divide Z by AM 
in order to get the correct partition function. 

If we go back and include the AM factors in the sum of the original entropies: 



Si + S 2 = 2Si = 2 



k B 



m^ 2 
Vat/2 



+ -lnT + a 



Nk b 
S 



In 



+ -lnT + ao 



2.1.3 The Equipartition Theorem 

Consider a classical system with 2/ degrees of freedom and energy 

E {l) = E (Pi,P2, ...,pf,qi,q2,---, Qf) 
with / generalized coordinates qi and / generalized momenta pi . 

Theorem: Let one degree of freedom (either p or q - without loss of generality, pick p\) 
enter E quadratically, and let E be an arbitrary function of the remaining degrees 
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of freedom. 

E = ap\ + £ (p 2 , ...,pf,qi,...,q f ) 
where a is a constant. Then p\ contributes \k B T to the internal energy. 

{ap\) = \k B T 

Proof: 

i a Pi) = j dqidq 2 ... dqf dpi dp 2 , ...,dpf ap\e~ l3E ^ 

f apje- f3ap i dpi f e -P£(P2-Pf,qi-q f ) dp 2 ... dp f dqi . . . dq f 
j e-^Pi dpi j e -P£(p2... P f,qi...q f ) dp 2 ... dp f dqi... dq f 

Let p = \fap\ 

fp 2 e-PP 2 dp 
~ f e-PP 2 dp 
1 

= \k B T 

Remark 1: Every quadratic or harmonic degree of freedom contributes \k B T to the 
internal energy and ^R to the specific heat per mole. 

Corollary: For a system with 2/ degrees of freedom, all of which are harmonic, the 
internal energy and specific heat per mole are: 

U = fk B T 

C v = fR 

which are collectively known as the "equipartition function" . 
Remark 2: The equipartition theorem only holds classically. 

Remark 3: Quantum mechanically, it holds to good approximation if k B T is large com- 
pared to typical spacing between energy levels. 

Examples: 

1. Consider a 1-d classical harmonic oscillator: 

=>• U = k B T, C V = R 
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2. Consider instead a solid with Na atoms/mole that is well modeled by Na 3-d 
harmonic oscillators with energy: 

3N A . 2 v 

where % are suitably chosen "normal coordinates" , and pi are the corresponding 
conjugate momenta. Classically, one expects that 

^ = (2N a )h B T = 3N A k B T 

C V = 3R i- "Law of Dulong and Petit" 




Realm of QM 



Remark 4 : The Dulong- Petit law is well obeyed for high temperatures, where T > Qd 
where 0£> is the Dulong temperature. 




Figure 2.2: Q D « 100 - 400 K for most materials. 
For T <C ©d, C„ ~ T 3 (DeBye's Law, see solid state physics). 
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2.1.4 Maxwell's Velocity Distribution — Part I: Canonical Ensembles 

Consider one molecule of a classical gas. The energy of the molecule is: 

E = ^- + U(x) = E(p,x) 

Remark 1: U{x) is complicated since it depends on all other molecules. 

Remark 2: Consider the molecule as the system, and the rest of the gas as the heat bath. 
Thus we have a canonical ensemble (this will be justified later in §2.1.5). Thus, the 
probability density for the molecule to be at point x with momenta p is: 

p(x,p) ~ e pE( *rt 

Thus the probability density for the molecule to have a momenta p irrespective of 
its position would be: 

p(p) = J p(p, X ) dx ~ e /V/2m J e -/3U( X ) 
= C • e -/V/2m 



Remark 3: No matter how complicated U(x) is, J e @ u ( x ) can depend only on j3. 
Normalizing: 

1 = J p (p) dp = C J e-^ 2 /'™ dp 

/•oo 

= C(4tt) / p 2 e-P p2 / 2m dp 
Jo 

= C(Att) I — J J x 2 e x dx 



4 



= C{2nmk B Tfl 2 

^C = (2Trmk B T) 3/2 

=> pip) = wt7,^ v //2m = momentum distribution 

(2Trmk B Tf 2 

Now our goal is to determine the distribution for the velocity modulus v = \v\ = ^\p\- We 
know that probability is conserved, and thus: 

p(v) dv = p(p) dp 

= p(p = mv) dp x dp y dp z 

= m 3 p(p = mv) dv x dv y dv z 

= m 3 p(p = mv) dv 
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And 



=> p(v) = p(p = mv) 

p(v) = J p (v) v 2 dv dQ. 

= 4ttv 2 p (v) 

= 47rm 3 v 2 p (p = mv) 



p(v) dv 



\ 3/2 



v 2 e -Pmv 2 /2 



2irk B f) 

is Maxwell's velocity distribution. 

Remark 4 : p( v ) is isotropic so it makes sense to consider p(v). 

Remark 5: Watch your Jacobians while changing variables. Probabilities (NOT proba- 
bility densities) must be equal. 



Discussion: 



P'ina-1 




where vt is the most probable (typical) velocity. Consider now the values of the 
different velocity measures: 
1. 

p(v — > 0) ~ v 2 
p(v -)■ oo) ~ v 2 e~ Cv2 
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2. Mean velocity: 



(v) = / vp{y) dv 



\2TTk B Tj \ m J J 



x 3 e x2 dx 



4 (2k B T\ 1/2 
\/tt \ m J 

k B T\ 1/2 [8 



ye y dy 



3. RMS Velocity: 



Vrms — (v ) 



m J V vr 

m \ 3/2 '°° 
3/2 



5/2 ^oo 



1/2 



2<Kk B T) 
^3/2 \2k B T) \ m J J 



1/2 



4vr 37T 1 / 2 (2k B T 
m 



vr 3 / 2 8 
\ m J 



1/2 



1/2 



4. Typical Velocity: 
dp 

Vt dv 



Vt 



= 2ve~ v2m/2kBt - V 2 ( \ e -^rn/2k B T 

\2k B T 



v t 



1/2 



/ , ,,,,, : (v) : v t = V3 : J - : y/2 = 1.2225 : 1.128 : 1 

7T 



5. Standard Deviation: 



a = ((v 2 ) - (v) 2 ) 

= fk B T_\ 1 ' 2 
\ m J 



1/2 



7T 



1/2 



0.67 



k B T 



m 



1/2 



6. Relative Flucuation: 



(v) 



0.422 



And thus we do not have a sharply peaked distribution! 
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There is only one energy scale (thermal). So dimensionally: 

E ~ mv 2 

1/2 



(k B T) ~ 



„ = ci^) 

m J 



/. T \l/2 

Remark 6: So (v) ,vt,v rms all must be some number times (-^-) by dimensional 

1 /2 

analysis, fc#T is the only energy scale in the problem, and (^r) is the only 
velocity one can construct from that. 



Remark 7: For N 2 , (m = 2 • 14 • 1.6 x 1(T 27 kg) at T = 300 K, we have that 



k B T ( 1.38 x 10~ 24 • 300 



\2- 14- 1.6 x 10- 27 
300 m/s 
speed of sound 



2.1.5 Maxwell's Velocity Distribution — Part II: Microcanonical Ensem- 
ble 

Consider an isolated classical gas, N particles in a volume V, and thus a microcanonical 
ensemble applies. By §1.4.2, we know that 



p{E) 



1 



1 if Etnt - AE <E <E, 



tot 



AE I otherwise 



P(E) 



AE 



1 

AE 



± 

E to t 



E 



If we let AE -»• 0, then p(E) = - E tot ). 
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Remark 1: The delta function reflects energy conservation. 
We will define 

to be the total energy per particle. Then, considering an ideal gas for simplicity, we have 
that 

N 2 



i=i 



What then is the probability density for a particle to be at some point in phase space 

p(p,q)=A N 5(E(p,q)-N£) 



( N 2 \ 



where An in the normalization constant. Now, define 



(N£): = J d Pl dp 2 ... dp N J d Xl dx 2 ... dx N s(j^ + ^ + --- + ^-N£ 

= V N fJpk + P A + ^ + ... + ^ + P \ + Pk_ NS ) d p lx d lydlz ...d Nx d Ny d Nz 
/ \ 2m 2m 2m 2m 2m 2m 



Let 



Since 



then 



P = (Plx,Ply,Plz, ■ ■ ■ ,PNx,PNy,PNz) 

I N (N£) = V N js^ip-p)- N£^j d 3N p 



I N (N£) = 2mV N J 6 (p 2 - 2mN£) d m p 

POD 

= 2mV N S 3N / p 3N ^5 (p 2 - 2mN£) dp 
Jo 

where S%n is the surface of a 3iV — 1 unit sphere. Letting x = p 2 : 

I N (N£) = 2mV N S m7) / x (3N - 2 ^ 2 6 (x - 2mN£) dx 
2 Jo 



= mV N S 3N (2mN£f N ' 2 ^ 2 
= V N (2mf N / 2l 2 S 3N (N£) 3 -T- 1 
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Now, by normalization: 



J P(P, q) d P dq = A N I N (N£) 



A 



1 



N 



In(N£) 

Now consider particle 1. What is the probability density for particle 1 to be at point x 
with momentum p, irrespective of the other particles? 



(pi,xi) = J dp 2 -..dp N J dx 2 ...dx N p(p,q) 
= An J dp2 . . . dpN j dx2 . . . dxjv <5 



1% +... + *$*. 
2m 2m 



N£ 



PL 

2m 



= A N I 



NJ-N-l 



N£ 



2m 



e ns 



2m 



In 



where the function is a statement that the energy of p\ can't exceed the total energy. 

=>• p (1) (pi,£Ci) 



^(2m) 3JV / 2 ±S 3 iv (iV£:)( 3JV - 2 )/ 2 



5. 



3(JV-1) 



^(2m) 3 / 2 5 3W (ATf)3/2 



i— *U 

2miV£ / 



(3JV-5)/2 



2m 



Now we'll take the thermodynamic limit, recalling that Sd = r(d/2) 



N-l s 



r s N 2^ r v 

iim — = nm 



N^oo S N -! N^oo 7 (N/2) 2tt( n - 1 )/ 2 

nToo T{N/2) 2 N ~ 2 r(N/2) 

tt(N-2)[ 
= lim k 

By the Stirling approximation: 

(N - 2) N - 2 e^ N - 2 ^2TT(N -2) 



n lim 



1 + 



lim \ I — — — 

AT^oo V N - 2 

F2tt 



l + O 



lim . , 

Af^oo V N 



l + O 
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Now, looking at 



/ a \ bN+c 
lim 1 - — 

7V-S.OO V N J 



lim exp 

7V-s>oo 



(bN + c)\n 1-- 



a 



N)\ 



cxp 



1 + 'iv 



So 



(p,*)) 



(27r) 3|/2 53^-3 5 > 3Af_2 SzN-l 1 

^ S 3 N-2S 3 N-1 S 3 jv (AT£) 3 / 2 

1 1 



1 p 2 /2m^ 



3iV 5 
2 2 



TV 



6 ( N£ - 



2m 



lim (p, ./• j = — — i — | 

V (2mN£) 3/2 V 27r / 



3iV\ 3/2 _3j^ 
I e 2 2m £ 



Define 



Then 



k B 9 : 



2£ 



p« (p,x) = 



y (27rmk B e) 3/2 



exp 



2mk B 



l + O 



N 



We can then integrate over x if we want to get the momentum distribution. 

Remark 2: This is again the Maxwell distribution with (3 = where 6 is the micro- 
canonical "temperature" . 



Remark 3: In the microcanonical ensemble, energy is the fundamental variable, and thus 
temperature is defined in terms of total energy per particle. 



Now consider the probability distribution for 2 particles: 
p {2) (pi,xi,p 2 ,x 2 ) = J dp 3 ...dp N J dx 3 . . .dx N p(p,q) 



1 



e ns 



PI p% . \ 2,11 S;;\ 1 



2m 2m J J V 2 S 3N (N£) c 



\ (pI + pI) 

2mN£ 



3N 8 
2 2 



lim = 



(2m)' 



3N 



cxp 



-3 {pI+pI) 



a -- -,. ' V \2tt 

(pi,Xi)p^ (p 2 ,X 2 



2m£ 



(N£) c 



l + O 



N 



l + O 



N 
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Remark J^: N — > oo simplifies calculations! 

Remark 5: In the thermodynamic limit, the particles become statistically independent. 
This justifies the canonical treatment, where we were treating 1 particle as the 
system and the rest as a heat bath. 



2.2 The Ideal Fermi Gas 

2.2.1 Distribution Functions and the Equation of State for Fermions and 
Bosons 

We want to look at an ideal quantum gas (fermions or bosons) where we will characterize 
single particle energy states by the momenta p. 

P 2 

f — — 
tp ~ 2m 

The phase space volume, d^y gives 

c?7 dp dx 
(2irhf ~ (2tt7i) 3 

The number of particles in a particular phase space volume is: 

;»r \ ^7 1 dpdx 

dN = (Np) • = ——r s — = 

(2vr^) 3 e P( £ r-ri±l (2irh) S 

# particles ' 
per state states per 
volume 

Remark 1: The upper sign is for fermions, the lower for bosons. 

Remark 2: For particles with spin S, there are 25 + 1 = g possible values of spin 
projection. Thus all energy eigenstates are g-fold degenerate. 

^ m 9 dpdx 



(2TThf exp \p (S p - n)] ± 1 
The number of particles with momenta between p and p + dp is 

.:\„ / dXdx 9V dP 



JV 



l v ' (2nhf e^p-ri ± 1 
And the number of particles with p = \p\ between p and p + dp: 



AitgV p 2 dp 

dN„ = o— ^? s (*) 
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2 

where £ p = ^— . This is the distribution function for the modulus of the momentum for an 
ideal Fermi or Bose gase. 

Remark 3: (*) is the quantum mechanical analog of the Maxwell distribution, §1.1.4. 
Let's now switch from momentum to energy: 

£ = ^— =>■ d£ = — dp 
2m m 

m m 
=>■ dp = — d£ = , d£ 
P V2m£ 

By conservation of probability: 

p{p)dp = p(£)d£ 

m m 

m gV 2m£ 

_ gVm 3 / 2 £ 1 ' 2 
~ v^vr 2 ^ 3 e^ e ~^ ± 1 

Remark J^: p(£) d£ equals the number of particles with energy £ ([£,£ + d£]). 

PCX) 

=> N = p(£)d£ 
Jo 

gVm 3/2 roc £ l/2 



2lT 2 h 3 Jo 



p(p) dp 

gv r p 2 



d£ 



2- 2 ^ J ePl^-ri ±l dP 

) 
) 



n 

y 1 



eP{£ n -n) ± l 

n 

Thus the transition from discrete quantum states to continuous ones is accompanied 
by taking the limit: 
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^ p p 

n u 

Remark 5: The density of states(DoS) per unit volume, u(£), is determined by: 



u(£) 




Remark 6: Alternatively, one can derive the density of states by "fitting waves into 
boxes" . Consider a quantum mechanical particle confined in a 3d cube of length 
L. The wave function is: 

. / 2nn x x\ . / 2irn v y\ f 2irn z z 
ip ~ sm ( — - — sin — — — sm ' 



L J \ L J \ L 

where 

n x,y,z = the number of waves fitting into the box 



The number of states with between k and fc + dk is given by 

>) 

So the density of states is: 



L\ 3 
' J dkx dky dJxiz 



,,x „ Vdk x dk y dk z 
"(k)dk= {27T) y -g 
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Which gives 



s „ , s , Vdp x dp y dp z ■ g 

u(k) dk = w(p) dp = — ^ 

(27m) 



4irVgp 2 dp 

= (27m) 3 = ^ 

(2vr^) 3 V 7 V 2£: 



Vgm z l 2 1/2 



Before we wrote the density of states per volume, so it was already divided by V. 
Recall from S1.4.3.R2 that 



/>oo 

= / 

JO 



which applied either classically or quantum mechanically. Thus, for us to determine the 
equation of state for a quantum mechanical gas, we need to find J. By §1.5.4 and §1.5.5, 
we have that 



J = ^k B T J^ln [l± 



And in the thermodynamic limit, 



J = ^k B T y - — I £ 1/2 ln 



V2ir 2 h 3 Jo 



lie 



(*) 



Proposition: The grand canonical thermodynamic potential J of an ideal quantum gas 
is: 



-%nVm 3 l 2 
J = — ^ 



Proof: We integrate (★) by parts, with di> = \f£ d£, u = In [l ± e^ - ^] : 

^(m-£)(-5^t) 



V^TT 2 ^ 3 7o 3 1 

,y m 3/2 ,oc £3/2 

2tt 2 ^ 3 io e^-/*) ± 1 



± e /3(M-£) 



+ 



stuff (f 3 / 2 In [l±e^- £ )]) 



-|gFm 3 / 2 



Corollary: The equation of state for an ideal quantum gas (in 3d) is: 

PV= 2 -U(N,T) 
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Proof: By §1.4.4, we know that J = -PV: 

POD 

/ Sp{S) 
Jo 



u 



s/2ir 2 h 3 Jo eP( e -ri±l 2 2 



Remark 7: Since this is completely general, it must hold in the classical limit. By §1.1: 

U = N-k B T 
2 

PV = Nk B T = -U 
o 

However, this is only true in 3d! 



2.2.2 The Degenerate Gas 

Consider a Fermi gas at T = (the "completely degenerate case"). By §1.5.4, the particle 
number can be given by: 



jy = Ew = £ eg( 4) + 1 = E^-^ 

p p p 

y 3/2 poo 



2Vm?/ 2 



V2ir 2 h 3 Jo 
_ 2Vm^2 2 3/2 



Figure 2.3: The shaded region is the energies filled to £p, which 
depends on the number of particles. 

Thus the Fermi energy in terms of the density is 

= M!^2 n 2/3 

2m 

Definition 1: The Fermi momentum pp, is dehned by: 

2m 
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And the Fermi wave-number kp is hkp = pp. 

^p F = y / 2m£ F = (3^ 2 ) 1/3 tin 1 '* 

From §2.1, we know that the pressure is: 



p = w u 



2 2Vm 3 / 2 f°° 



3V V2vr 2 ^ 3 
4 m 3 / 2 2 5/2 
3^2n 2 h 3 5 F 



poo 

/ £ 3/2 Q (£ F - £) d£ 
Jo 



rrr 



3/2 



15 V2tt 2 /> 3 
(3- 2 ) : 



3vr 2 ) 5/3 h 5 



(2m) 
lh 2 ^^2/3^/3 



5/2 



n 



5/3 



5 m 

= pressure in terms of density 
Remark 1: P ~ n 5 / 2 as opposed to P ~ n in a classical gas. 

Remark 2: The gas is degenerate for T <C ^ : = Tp, where Tp is the Fermi temperature. 

Remark 3: Important Applications: electrons in metals 

£ F ~ 10 eV => 100000 K 



Remark 4 : Other important applications: He s , white dwarfs, neutron stars. 

2.2.3 The Specific Heat of a Degenerate Electron Gas 

We will be considering low temperatures: < T <C Tp 
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By §2.1: 



2 gVm 3 / 2 r . 



3 V2vr 2 ^ 3 

J(M,r)= / 

JO 

Let &b = 1, 2 = dz = ^ d£: 
(fi + Tzf 2 



lo eP( £ ~ri + 1 



I(j 1 ,T) = tJ_ 



T 
T 



n/T e 2 + 1 
00 (// + Tz) 3/2 
„ e- + l 

00 i'., , ^^\3/2 



dz + T 



L 

H/T 



»/ T (y-Tzf 2 
e~ z + 1 



1 + 



Let a; = //- Tz, = -To!z, £ < 1: 



I(ji,T) = T 



fi T 3/2 



dx + T 



(n + Tz) 3/2 - (/x - Tz) 3/2 



e z + 1 



+0 



temp 
contribution 



9 ^00 
= |^5/2 + 7> 3/2 



correction terms 
goes to as T — > 
faster than linearly 

3/2 







4' 5/2+ 



dz 


+ - 

V A* 


l + e z 


dz 


3T 
_ 1+ 2^ 


l + e z 



T 

1 z 

A* 



3/2' 



3T 
2 /? 



5/2 + 3T 2 1/2 / dz +(D / T 4X 



^2 
12 



= V /2 + ^/// 2 T 2 + 0(T 4 ) 
5 4 v 7 
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By §2.2, f i = £ F + 0(T), 

= Jo 
= Jo 



VT 2 m 3/2 



6fr 3 



^ 2 ) 1/3 h (n\ 



/ 2m 



T 2 m 



(y) 



1/3 



1/3" 



= Jo- NT 



4 £p 



Remark 1: We have calculated J at fixed ji (recall that /j, = /i(T, N)) 
To get C v , we need F, not J. But 

dF = -SdT -pdV + fidN^ 



dJ = -SdT -pdV - Ndp, 



Wv* = (5F)v,n 



F = F(T = 0) - 



NT 2 ir 2 T 
A£ F 

-dF Nk 2 R iT 2 T „ , 
=> S = — = — — [Kb f 1 1 anymore) 



dT 



2£ F 



„{dS\ Nk B ir 2 fk B T\ ^ f T \ 2 . , 



Remark 2: Any fermion system of T <C Tp (eg. electrons in metals at room temperature) 
has linear T-dependence of specific heat. 



2.2.4 Pauli Paramagnetism 

By quantum mechanics, for electrons in a magnetic field, the energy depends on the value 
of the z-component of the spin (Zeeman effect). 



B = magnetic field 
eh 

HB = = bohr magneton 

2mc 

g = 2 for electrons 

-4 
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Remark 1 : Consider the coupling of B to the electron spin only. 
Some interesting points: 

• Up and Down spins form two different subsystems that can exchange particles. 

• fi(T = 0) = £f is independent of S. (Since particles can be exchanged, \x will adjust itself 
accordingly.) 



There will, however, be different Fermi momenta: 

£f + HbB (up spins) 
~ HbB (down spin) 



2m 
2m 



Thus there are differing densities of states (See §2.2.1.R5). If we call oj-\{£) the density 
of states with up spins, then we have something like: Thus there are more up-spins than 

a 





-HbB J 




-HbB- 





down-spins 



Vp 2 



Ft 



6n 2 h 3 



Number of up-spins 
Number of down-spins 



Magnetic Moment = M = fi B (iV t - N± 

HbV 



^ bV ( 2m ) 3 / 2 



(£f + 



^ bV (2m) 3/2 £ 3/2 



■ + fiBf 2 - (£ F - nBf' 2 
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Remark 2: 1 T = 10 kG « IK 

[i B B <Z:£ F in metals (T F « 10 5 K) 
One doped semiconductor: 

Tp » 10 2 K; B < 30 T 

Neutron Stars: 

Tp = 10 11 K; B = 10 4 - 10 6 T 
Thus hbB <C £p in most all cases. 

Remark 3: Thus we have two different regimes, even for \xbB <S £f' 

1. /xb-B <C fc#T <C <fp - the "weak field regime" 

Here the energy spectrum is unchanged by the B fields (that is what we as- 
sume) . 

2. ks <C /U_ei? <C £p - the "strong or quantizing field regime" 

Here the energy spectrum is drastically changed from the B = case. ("Landau 
Levels" - a completely different physics, see Landau and Lifshitz) 



1 + 



(37T 2 ) ft 3 

(£) 

The magnetic susceptibility is thus: 

X 



1 c9M 



3 /x 2 

=^ Xp = 7.N -pr~ = Pauli Paramagnetic Susceptibility 
2 cp 

Remark 4-' Classically, ksT » £p and x ~ Thus £p sets a new energy scale such 
that 



X ~ 
X = 



T 
1 



for k B T > £p 



for fc B T < £p 
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X A 



<— Classically 



I QM 



k B T 



Remark 5: Xp > 0) as happens with paramagnetism. Note that the orbital angular 
momentum also couples to the B field, and yields a negative (diamagnetic) contri- 
bution to x- 

Remark 6: M can also be obtained from J. (See Hw) 



2.3 The Ideal Bose Gas 

2.3.1 Bose-Einstein Condensates 

Consider an ideal Bose gas. By §1.5.5, we have that 

1 



1 \- 1 

=/3(£o-m) - 1 + 2^ e P(£ k -») - 1 
MO e 



So iV = A^q + iV 7 = the total number of particles, where 



iVn 



^ _ number of particles in 
1 the ground state 



i 



t/ 3/2 /-co cl/2 
j v ' / number of particles 

\/2lT 2 ft? Jo e^~^ — 1 in excited states 

Remark 1: We have put £q = without loss of generality. 



Remark 2: By §2.2.1.R5, ~ f 1 / 2 , and thus in going from the sum to the integral, 
the ground state gets zero weight. 
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Remark 3: We can see that N (fx 0) -> oo. By the Hw, /z (T -»• T ) ->• with T > 0. 
Thus we can not neglect the number of particles in the ground state, even in the 
thermodynamic limit. 



N 



, gV{mk B Tf /2 ^ 2 



„l/2 



^2^h 3 2 Jo e x e~^-l 

3/2 



dx 



where 
for a > 0. 

Discussion of 1(a): 
1(0) = 



1(a): 



oo 1/2 



7T Jo e^e" ~~ 1 



c 



2.612 



Since e a > 1, then /(a) is a monotomically decreasing function of a. 

2 



I(a — >■ oo) 



7T 



-}l 2 e- x dx = e~ a 



2 



/(a)A 




Thus N' can at most be equal to N' x , and 



N' < N' 

' — x ' max 



Define Tq by 



9^ 
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k B T 



A H 2 

g 2 /3 m 



n 



2/3 



where 



A = 



2vr 



[C(3/2)] 



2/3 



= 3.3125 



Thus, for temperatures less than To, the excited states can not accomodate all of 
the particles! 

Remark 4-' See Hw for more. 

Proposition: In an ideal Bose gas at T < To, with 

A h 2 



k B T = 



g 2 / 3 m 



-n 



2/3 



a finite fraction of particles occupies the ground state, even as N — > oo. 

Remark 5: For the Hw: Show To is the temp where \i (T — > T + ) — > CP. 

Remark 6: The accumulation of a finite density of particles in the ground state is called 
Bose-Einstein condensation. 



2.3.2 Chemical Potential and Particle Number for T < T 

By §2.3.1, 

N = N - N' 



1 



-0M - 



1 + 



— (i = k B T In 



1 + 



1 

N-N' 



e -P» - 1 
1 

N-N' 
- fc^Tln 



1 + 



N-N' 



Remark 1: For a finite number of particles, fj, (T < To) assumes a small negative value so 
that the correct number of No = N — N' max particles are in the ground state. 



Remark 2: In the thermodynamic limit, N — > oo, while N' max equals a constant, and 
thus n (T < T ) = 0. 
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Consider the temperature dependence of Nq and N' with T < Tq: 



N' = gV 



m 



k B T\ 



3/2 



2ttH 2 J 



1(0) 



'mk B T \ 3/2 



N 
3/2 



3/2 



And thus 



iV 



rp \ 3/2 

To, 



and 



No 
N 



rp \ 3/2 

To) 



A 


A^\ 


TV' 




AT X 


/ N 








— >- 



To 



Remark 3: Entering in n,m for 4 He implies Tq = 3.13 K. 



Remark 4-' 4 He has a phase transition at T\ = 2.17 K. The reason for the difference? 4 He 
has interactions between particles, unlike the ideal case we have considered here. 



Remark 5: Bose-Einstein condensation has been observed in a weakly interacting system. 
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2.3.3 The Specific Heat of an Ideal Bose Gas 

For T < T , by §3.2 we have that fi = 0. Thus 



u V27T 



gVm 3/2 ,oo £3/2 



d£ 



2 W> J e? £ - 1 
gV (mk B T) 3/2 k B T ^tt 1 f 00 x 3 / 2 



dx 



gV 



nk B To \ 
2nh 2 J 



3/2 



C(3/2) 



C(3/2) 



r(5/2)C(5/2) 



3/2 



7T 



r (5/2) C (5/2) 



A? 



AT 



A" 



T\ 3/2 /c B T 2 3 



T / C(3/2)0^2 



r (3/2) C (5/2) 



2 



T\ 3 / 2 3 C(5/2) 
Toy* 2C(3/2) 



= 0.77 • Nk B T 
:=U (T) 



rp \ 3/2 



C„ (T < T ) 



d£/ 5 C/i 



o 



0.77 -Nk B — 



dT 2 T 2 
Now, for T > To, we need to actually know what /u(T) is! 

Lemma: 



r \ 3/2 



To/ 



M (T -> T +) 



-27T 2 ^ 6 n 2 
<? 2 m 3 (k B T Q f 



rp \ 3/2 



Proof: 



AT 



^/2vr 2 ^ 3 7o e/ ? (^"^) - 1 



gVm 



3/2 /-oo 



v^vr 2 ^ 3 Jo 



f l/2 



1 



1 



e /3(£-,u) _ i e 0(£) _ i 



+ N"(T) 



where 



Ar /// T0= y / ^ 

V v^vr 2 ^ 7 - 1 



AT 



T \ 3/2 
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Remark 1: For T < T , N" would be N' . 



Now, assuming T — > T^ and thus that \i — > 0, the leading contribution to the 
energy integral comes from £ ± , £ — fi <C 1 . 



/»oo 

Jo 



1 1 

e /3(£- M ) - l ~ eP £ - 1 



(if 



1 1 



poo 

/ £1 

■/ 

poo 
J 

7o \/£ (£ - m) 



f (f-M)J 



Let x = £/ — \x 



poo -i 

= k B T(-^/\-l) — 
Jo V x { x 



+ 1) 



dx 



= - 7rkB T(-v) 1/2 + 0^ 3/2 ) 



-gVm 3 / 2 7r 7 m ^_ /T\ 3/2 



-A* 



/ j, \ 3/2 



-A* 



2^ 2 ft 6 n 2 
5 2 m 3 (fc B T )^ 



N" 

2tt 4 ^ 6 1 
# 2 m 3 vr 2 (fc B T) 2 

2 



\ 3/ 2 



to lowest 
order 



By §2.1, we know that J = —pV = -§[/. 



at/ 



___35J = 3 
8/jl 2dn 2 



And thus 



17 = Ufa = 0) + -Nn 
= U (T) + ^(T) 



_dU _ dU (T) 3 d»(T) 

v dT~ dT + 2 
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Remark 2: We know fi(T) only to leading order as T — > T + , so let's replace Uq{T) with 
Uq(Tq) (keeping just the leading order term): 



C V (T^T+ 



dU 



dT 



3N 2ir 2 h 6 n 2 



To 2 9 2 mHk B T ) 2 
9TT 2 h 6 n 2 Nk B 



■ 2 



rp \ 3/2 

'"'Sb) 



-3\ /^y /2 2. 



not leading 
matrix 



= C V (T )-Nk b . 



/ j, \ 3/2 



3/2 



I) 




Figure 2.4: Notice the "A" shape, and thus this is called the A 
transition. 



Remark 3: C V (T) is continous, but not differentiable at T = To, where we have a cusp 
singularity. 

Remark 4'- In 4 He, C V (T) diverges at the A transition, as interactions lead to a stronger 
singularity. 

2.4 Black Body Radiation 
2.4.1 Planck's Law 

Consider photons in equilibrium with matter. Photons have spin 1, and thus Bose-Einstein 
statistics apply. 
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Remark 1 : Photon-photon interactions are extremely weak, (mediated by virtual e — e + 
pairs) Thus some matter is necessary to reach equilibrium. 

Remark 2: Photon gas can be considered ideal if the matter is dilute (eg, in a dilute gas 
or the walls of a cavity whose only role is to absorb and emitt photons). 

Remark 3: Photon number is not fixed. 

Proposition 1: A photon gas, in equilibrium with matter, has zero chemical potential. 

H = 

Proof: We want to minimized the free energy with respect to the particle number: 

fdF\ 



\dN 



N,T 



Corollary: The mean number of photons with frequency ui with temp T is: 

= e^TT 

Proof: Use a Bose-Einstein distribution with £ w = Huj and \i = 0. 

Proposition 2: The energy contained in the frequency interval [u,uj + duo] is given by: 

d\J w = uioj) duj 
with the frequency distribution function: 

- Vh ^ 
U{UJ} ~ vr2 c 3 e Ph» _ i 

This is Planck's Law . 

Proof: By §2.1, the momentum distribution is: 

( \ = 9V p2 
P[P) 2vr 2 /i 3 eft^-ri - 1 

For photons, \x = 0, £ p = pc = Huj, g = 2. {g ^ 2s + 1 since the rest mass of photons 
is 0). Conserving probability: 

, dp h 2V H 2 oj 2 

/>M = p(p)^ = - 27rWe ^3i 

- V ^ 
~ e^ - 1 
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with p(u) du being the probability of finding a photon with frequency in the interval 
[u, u + du]. Each photon carries energy hu and thus: 

U(u) = hwp(u) = ^ _ i 



2.4.2 Discussion of Planck's Law 

, N Vh (0hcf 

U(U) = q 7TZ 

V(k B Tf f hu \ 
n 2 <*H 2 1 \k B TJ 

where 




Proposition 1: The maximum of the radiation intensity occurs at a frequency: 

k B T 



2.82- 



which is called Wien's Displacement Law. 
Proof: 



df ( 3x 



dx V e x — 1 e x — 1 



e x - 1 



94 



CHAPTER 2. SELECTED APPLICATIONS 



3 ( e * _ l) = xe x x = 2.822 

Proposition 2: In the limits of low frequency, Hoj <C k B T and high frequency Hlo 3> k B T, 
Planck's Law simplifies to the Rayleigh-Jeans Law, 

, Vk B T o 
u (uj — > 0) = — t^-uj 

TT Z C 6 

and to Wien's Law , 

Vh o -f%, 

u (uj ->■ oo) = -^-ito; e fc s T 

Proof: 

/ ( x 0) = x 2 + (x 3 ) 
/ (a; -> oo) = x 3 e~ s [1 + O (e~ x )} 



2.5 Relativistic Degenerate Electron Gas 

Consider a reativistic electron gas at T = 0. 



Proposition 1: The internal energy density is given by 

U m 4 c 5 



K + sinhC] 



V 32^ 2 /i 3 
where 

e = 4sinh- 1 f^ N ) 
\mc/ 

Proof: For a relativistic electron, 

£ p = c\J m 2 c 2 + p 2 

And thus 



poo 

(Sp) = / £ p p(p) dp 
Jo 



f°° I gVp 2 

L cVm2c2+p2 2^(e^) + l) dp by§2 - 2J 



CgV j P (m 2 c 2 +p 2 ) 1/2 p 2 dp takingT = 

J \ \mc/ J \mc/ \mcJ 



2ir 2 h 3 

cgV roc / , n x 2X 1/2 

gVm 4 c 5 f PF/mc 
2it 2 W> 

gVm 4 c 5 



27T 2 ^ 3 



rPF mc , 
\ x 2 (l + x 2 ) l/2 dx 

JO 

\ (-) f 1 + (-) 1 1/2 - 5 (-) f 1 + (-) 2 V /2 - \ in (- + \A + 

4 \mc/ \ \racJ J 8 Vmc/ \ \mc/ J 8 \ mc V 
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But 

And thus 



+ \A + x 2 ^j = sinh 1 (x) 

l 4- + \l 1+ (-) 2 )= s ^- 1 (-)■■= 2 
\mc V \mc/ I \mc/ 4 



mc 



U = 



gVm 4 c 5 

27T 2 k 3 

Vm A c 5 
32vr 2 /i 3 
Vm 4 c 5 

Vm 4 c 5 



- sinh ( - | cosh 3 , 
4 14/ V 4 



; + i sin]) ( cosh f| 
-£ + 4 sinh ( - J cosh ( — 



1 



- sinh | - | cosh ( - 
8 U/ U 



-1 + 2 cosh 2 



+ 4 cosh ( - ) sinh 



32vr 2 ^ 3 
Vm A c 5 r , . , 
32^3 K + Smhe] 



+ ^ sinh£ - ^ sinh f | J + ^ sinh£ + ^ sinh 



1" 

32 

with 



Proposition 2: The equation of state can be written in parametric form as 



Proof: By §2.2.2, 



And thus 



m 3 c 3 



n = 



3vr 2 /> 3 

4 5 

m c 



sinh 3 -7 



£ + - sinh£ + - sinh ( - J 



p F = (3n 2 ) 1/3 hn 1 / 3 



= sinh 

mc 



£)=(3vr 2 ) 1/3 A n V3 



mc 



n 



P = 



-dU 



4 5 

—mc 



d_ 
dV 



(mc) 3 

Vm c 5 
32vr 2 /i 3 



sinh 3 



-£ + sinh£) 



(- 



32^ 2 7i 3 
f7 Fm 4 c 5 



. . . Vm A c 5 ( d£ ,,dC 



V 



+ 
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but§ 



dV 



3V 



tanh 



(0 



4 5 
m c 

32^3 



i + sinh£ - .| tanh f | ] ( ' - t'osh ) 



4 5 

m c 



1 ■ i . 8 • , (i 

f H — sinn t sinn - 

S 3 S 3 V2 



Remark 1: In the non-relativistic limit, pp <C mc and thus 



= sinh ( - 



mc 



4 



and 



m 3 c 3 /t)c\3 



n 



37r 2 7i 3 \mcJ 3ir 2 h 3 



P 



4 5 

m c 
32^3 

4 5 

m c 
32n 2 h 3 



1 1 

45! 



£3 £5 

^ + 3! + 5! + 



e 5 + o(e 7 ) 



m c 5 1 1 / 4p^ 



32vr 2 ^ 3 4 5! V mc 
(3^) 2/3 ft 2 n 5 / 3 
5m 



2 3! 



+ 



(C/2) ; 
5! 
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Chapter 3 

Introduction to Kinetic Theory 



3.1 The Boltzmann Equation 

3.1.1 The Fundamental Question of Kinetic Theory 



The Model: Consider a gas of particles with no internal degrees of freedom. Collisions 
are described by classical mechanics, and we will consider only binary collisions. 




o 



Figure 3.1: In a "dilute gas", the particles will be rare enough 
that we can consider only binary collisions (no 2 particles hitting 
another simultaneously) . 



Remark 1: The last model assumption restricts us to a dilute gas. 
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Consider the singe particle distribution function from §2.1.5: 



f(v,x,t) = {v,x,t) 

= / dv2 . . ■ dv n dx2 ■ ■ ■ dx n p (v, x, t) 




Remark 2: We do not assume equilibrium, and thus / is explicitly time dependent. 

The Fundamental Question: What is the equation of motion for /, and what are its 
solutions? 

Remark 3: The answer to this question will reveal how the system approaches equilibrium. 
Proposition: The equation of motion for / can be written as a PDE: 



\ / collisions 

is the time derivative of / due to collisions, and F ext is the external force, if any 
(gravity). 

Remark 4- (t) is the desired equation of motion for /. Equations of motion for distribu- 
tion functions are called kinetic equations. 



Remark 5: <£ is called the collision operator. It maps / onto some other function <£(/) in 
the space of distribution functions. 

Remark 6: Once we can determine C exactly, the problem is solved exactly by solving 



Remark 7: Boltzmann's strategy was to classify collision events with respect to the 
number of particles involved (binary collisions, tertiary collisions, etc). This is 
effectively a density expansion. 

Remark 8: Using £ for binary collisions gives the Boltzmann equation, which is a low 
density approximation to (f). 

Proof of Proposition: Assume we have no collisions, then the particle under consider- 
ation is a closed subsystem, and thus Louiville's equation holds for = f. By 




d_~ 
dv 



f(v,x,t) = €(f){v,x,t) 



(t) 



where 




the PDE. 
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51.5.1.C4, 



= ±f(v,x,t) 

df ^ df df 1 

ot ax at? m 



Collisions lead to a non-zero total time derivative: 

but -£ = 0, which is a statement of conservation of probability. 

= £(/) 



dt \dt J 



collisions 



\<9t dx m ext dv J 



3.1.2 The Collision Operator I: Scattering Out Distribution 

Let particles with velocities in [v, v + dv] collide with particles with velocities in [u, u + du]. 
Consider a reference frame moving with velocity u, and thus the targets are at rest, and 
hence the scattering particles move with velocity w = v — u. 

• Cross section for binary scattering: a 

• Number density of incoming particles: n v = f (v,x,t) dv 

• Number current density of incoming particles J v = n v w = wf (v, x, t) dv 

• Number of targets in volume dx: N u = f (u,x,t) dx du 

• Total scattering cross section: £ = N u a 

• Number of collisions per unit time: £ • \J V \ 



s _/ 









— 
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Notice that dv is infinitesimal, and thus any collision will remove the scattering particle 
from the incoming beam. Thus 




(v, x, t) dv dx = — S • \ J V 



= —of (u, x, t) du dx ■ wf (v, x, t) dv 

= the number of particles scattered out of the beam 

per unit time by targets with velocities in [u, u + du] 

Integrating over u yields: 

Cout(/) (v,x,t) = -f(v,x,t) / \v-u\of(u,x,t) du 



3.1.3 The Collision Operator II: The "Scattering In" Contribution 

A colliding pair has characteristics: 



u',v' beforel 
u, v after ( 



elastic collision 



So by conservation laws: 



u + v = u' + v' momentum 



2,2 /2 . i2 

u + v = u + v energy 

(u + v) 2 = u 2 + v 2 + 2u ■ v = u 2 + v 2 + 2u' ■ v' 
u ■ v = u ■ v' 

(u - v) 2 = u 2 + v 2 - 2u ■ v = u' 2 + v 2 - 2u' ■ v' = (u' - v'f 

^\w\ 2 = \w'\ 2 (J) 
Now let's define the differential cross section as 

da 

a= dQ 

We will rewrite the "scattering out" term from §3.1.2 using 

a = j do = jo dQ! 

du = w 2 dw d£l (*) 
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(f)(v) = -f(v) J dndn' J dw w 2 waf(u) 

dSLdSl' [ dww 3 af(u)f(v) 



We can obtain the "scattering in" term from the "scattering out" by interchanging the 
primed and unprimed (effectively switch before and after) and also changing the sign (since 
now we are scattering things into the beam, instead of out). 

€in(f)(v,x,t) = + f dSHdSl J dw'w' 3 af{u')f(v') 

dU'dn [ dww 3 of(u')f(v') by (t) 



= J dfl' J duwf{u')f(v')o by (*) 
=> €i n (f)(v, x,t) = J ' du j dto' \v - u\ of (u, X, t) f (v, X, t) 

3.1.4 The Boltzmann Collision Operator 

By §3.1.2 and §3.1.3: 

£(/)(«) = £in(f)(v) + £ out (f)(v) 

= JduJdn\v-u\o [/(«')/(«') - /(«)/(«)] 

Lemma: For any function F(u',v'): 

J dSl! \u-v\F (u', v') = J dn' J dv'5 (u + v-u'-v')-S (u 2 + v 2 - u' 2 - v' 2 ^j F(u', v') 

Proof: Life is finite. . . we're skipping it! 
Proposition: The Boltzmann collision operator can be written: 

£(/)(v, x, t) = J dudu' dv' W (u, v, u' , v') ■ [f {y! , x, t) f (v r , x,t) — f (u, x, t) f (v, x, t)] 
where 

W (u, v, u', v 1 ) = 6 (u + v - u' - v') 5 (u 2 + v 2 - u' 2 - t/ 2 ) o{x) 

with x being the scattering angle, which will be a complicated function of the 
velocities. 
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Remark 1: £ is a non-linear integral operator. 

Remark 2: Since we are considering only binary collisions, then we are "only" dealing 
with quadratic non-linear functions. 

Remark 3: Our derivations ignore correlations between particles before and after colli- 
sions. 

=> f(u)f(v) rather than p( 2 \u,v) 

Remark 4 : In general, <£(/) = €{p^) depends on p( 2 ); £(// 2 )) depends on p^; etc. 
This is called a heirarchy of kinetic equations. (BBKGY) 



Remark 5: If we assume no correlations, then we have factorization of p( 2 \ which closes 
the hierarchy (though it is still non-linear) and = f. 

Remark 6: By §2.1.5, p^ factorizes for N — > oo, and thus the Boltzmann equation is 
valid (at most) in the thermodynamic limit, and for small densities n. Turns out 
that the Boltzmann equation is exact for n — > at fixed time t, but not for t — > oo 
at fixed small n. 

Corollary: The kernel, W (v, u, v' , u'), is positive semi-definite, greater than 0, and has 
the symmetry properties: 

W (v, u, v', v!) = W (-v, -u, -v', -v!) (1) 

= W (-«', -u', -v, -u) (2) 

= W (v',u',v,u) (3) 

= W(u,v,u',v') (4) 



Remark 7: The Boltzmann equation has a unique equilibrium solution: 

1 / \ 3 / 2 



